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CHAPTER I 



INTRODUCTION 



Nature of the Problem 

movement (Foreign Languages in Elementary Schools) has been 

*he nation for many years, and almost every state is seek- 

iL^g^S t'e“hL°s!’'" 

ture prolilera has become more acute since the state legisla- 

sixth seventh*"'^°*rt°”-^!!+h ^°P®^Sn language mandatory for aU students in the 

shorwrof nu^l??f»rf ’'“h 1^he 1965-1966 school year. The 

nentl^ qualified foreign language teachers is a serious obstacle to imple- 
meriting the law satisfactorily. 

ten that up to approximately age 

i! * imitative learning powers are greater than his powers of ana- 

hl^ Litat?ve®i‘e learning powers increase, whereas 

his imitative learning powers decrease. Consequently, the audio-lingual skills 

primarily by imitative capacity should be well established 
in elementary school, particularly in the lower elementary grades. 

improving instruction at the elementary 

are weakf ’ especially the availability of qualified teachers, 

instruction in the^^elemLtL^ grLes" One 
tLch!,.!*^^ hhe recruitment and training of qualified language 

achers. Other approaches largely involve materials which can be used by class- 
room teachers not trained as language specialists. This frequently means^the 
^d °f,”«^/”^h-ctional media, such as television, programmed ?ea?nin“ fJJ^s, 



pace ^°The®Li^+“?®® materials are becoming available at a rapidly accelerated 
pace. The market for such materials has become fiercely coiroetitive and it has 

difficult for teachers and administkto^ to^TLlLT 
and materials appropriate for their students’ needs. meiinoas 

of foreign language programs and proposals for improvements are 
increasing in number. The relative validity of theL criticisms! however ^d 
the value of new proposals are generally undetermined. Objective and reliable 
data concerning various teaching methods and materials are few. 

At present, in spite of many curriculum innovations, only a relativelv 
small number of high school and college graduates succeed in acquiring the desirer 
mastery of foreign language skills. One important reason is tharcoudf 
developers traditionally have had almost no objective baseline datrorLw much » 
given population of students can be expected to learn in a give7tLr ^der 

Ient°ffLss^^"t"^ conditions. Course objectives and course content usually repre 
sent gross estimates based on the developer’s intuition. Meaningful articula^ 
tion (which bases student progress from one sequence of instruction 4- 

on attai^ent of specified minimal levels of performance "harbeen lacking. 
Further, revisions of materials and procedures have rarelv been 4- *t 

empirical data on student achievement. ^ detailed 
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Ob.lectives of the Study 

In June 196U, the California State Department of Education, aided by System 
Development Corporation, began an l8-month study to assess the effectiveness of 
examples of three different approaches to teaching Spanish to sixth-grade pupils. 
The three approaches were: 

1. Instruction by television, consisting of three weekly 15Hninute telecasts, 

with classroom follow-up by the regular elementary school teacher two 
times a week. (Course: Una aventura espafiola (UAE),^ prepared by 

Pasadena City Unified School District and published by Heath de Rochemont 
Corporation. ) 

2. Programmed instruction, consisting of self-instructional material used 
under supervision of the regular elementary school teacher. (Course: 
Spanish A (SPA), published by Encyclopedia Brittanica Films, Inc.) 

3. Instruction by a qualified foreign language teacher using an audio- 

lingual course of study. (Course: Modern Language Association Teacher* s 

G^uide: Beginning Spanish in Grade T^ree (MLA). prepared by a national 

committee appointed by the Modem Language Association and published by 
the Educational Publishing Corporation.) 

The three courses of instruction were selected because they were appropriate 
to a variety of school situations, that is, variations in resources, availability 
of trained teachers, financial support, access to technical facilities aiid pro- 
visions for specialized professional guidance. 

The study was designed primarily to provide baseline performance data, and 
other information, to aid school administrators in decision-making and administra- 
tive planning related to initiating and conducting a foreign language program. 

Data from this study were intended to enable an administrator to relate the advan- 
tages and disadvantages of a particular set of instructional materials to the needs 
of his local school situation on the basis of: (l) his agreement with an explicit 

statement of objectives; (2) the effectiveness of the materials under specified 
conditions; (3) problems and difficulties experienced in using the materials; and 
(U) cost. Traditionally the administrator has lacked adequate data on anything 
but cost on which to base decisions. 

In this field test, no attempt was made to compare one language course 
directly with another. Comparisons of this type are generally difficult to make 
and to interpret. (This would be especially true in this case since the language 
courses differed in specific objectives and course content. For example, the 
three courses shared only 55 Spanish vocabulary words in common out of a total of 
approximately 900.) The aim of the project was to evaluate the extent to which 
each course achieved its own objectives. 

Further, it should be emphasized that the materials alone were not being 
evaluated, but rather the total learning situation. The major emphasis was not 
on evaluating how good the materials were, but on discovering under what condi- 
tions the objectives of a given language course were best achieved. In general. 



^Throughout this document the three courses will be referred to by their 
respective abbreviations. 
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where only a small percentage of the total objectives of a language course are 
achieved by most students, it is not clear that the materials are primarily at 
fault. Student differences, teacher differences, and teaching procedures may 
also be contributing factors . 

In some cases, performance might be improved through modification of the 
materials ; in other cases , through changes in teaching procedures or classroom 
organization. Where the learning conditions (e.g., total amount of instruc- 
tional time, lock-step system) remain unchanged, it may be necessary to limit 
objectives (i.e., set up more feasible goals) if more students are to have a 
successful foreign language experience. However, changes are not likely to 
result in improved instruction if they are not based on explicit information 
concerning what students can and cannot do mider various learning conditions. 
It was this type of information that the project was designed to obtain. 

In addition to its purpose of aiding administrative planning and deci- 
sion-making, the project has significiuice beyond the immediate geographic 
region, the specific content area, and the age group studied. Its wider sig- 
nificance stems from the use of an unconventional approach to the evaluation 
of instructional methods and materials — criterion-referenced testing. One 
of the purposes of this study was to investigate the feasibility of developing 
and administering such tests. A major objective was to determine how far the 
limits of comprehensiveness and objectivity in foreign language testing might 
be extended. 



Chronological Overview 

June 30 - September 30% 196U . During this period the staff of the 
project was recruited, and numerous mee+ings were held for the purpose of 
planning and implementing the work under the contract with the U. S. Office 
of Education. 

One preliminary task was the linguistic analysis of each course of study 
used in the project and the development of pretest and attitude measurement 
instruments. These tasks were performed by the project subcontractor. System 
Development Corporation . 

After the linguistic analysis of the three language coiirses was completed, 
a detailed list of course objectives (in terms of specific vocabulary, gram- 
matical, and phonologic elements) was prepared for each language course. This 
list was revised after conferences with the authors of each course. The re- 
vised list was used as a guide in the preparation of the criterion tests. 
Part-time consultants were hired by the training staff of System Development 
Corporation to assist in the preparation, production, and pretesting of the 
criterion instruments. 

The Spanish pretest of listening comprehension and instruments to measure 
students' pre- and posttraining interest and confidence in learning Spanish 
were developed. 

Four regional field consultants — one covering the Sacramento and Central 
Valley area, one the greater San Francisco Bay area, one the greater Los Angeles 
area, and one the San Diego area — were appointed and began working. School 
districts were recruited to participate in the project. Participating districts 
made arrangements for the purchase of teaching materials and for reimbursement 
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under Title III of NDEA. From e large nuaiber of dlatrlcta that expreiaed 
interest in participating in the project, a proportionate stratified sanple WM 
selected. A total of 20 counties, 6k districts, and 2lU schools ware involved 
in the sampling. 

Orientation aeasiona for teachers participating in the project ^re held 
by the field consiiltants. The pretest and the student attitude questionnaire 
were administered. A preinstruction teacher attitude questionnaire was also 
developed and administered. 

October 1 - December 31. 196^^ . The processing of pretests and student 
and teacher attitude questionnaire's for card punching was begun. The criterion 
tests for the midcourse testing were developed and printed, and tapes were pre- 
pared and duplicated. A student information form and a teacher background 
questionnaire were developed and administered. Class observation forms were 
developed and refined. Four regional meetings were held so that project 
teachers could confer with the authors of the materials and the research staff. 

The purpose of these meetings was to discuss the objectives of each of the three 
courses and classroom procedures to be employed. 

Demonstration classes were established in all three courses to encourage 
visitation withc<ut disturbing the conduct of ‘sample classes. 

January 1 - March 31. 1963 . Early in this period the midcourse tests were 
administered, and data processing was begun. The final criterion tests were 
developed and printed, and tapes were prepared and duplicated. 

April 1 - June 30, 1965. Final criterion tests and postinstruction 
attitude questionnaires for students and teachers were administered. Still 
another questionnaire was designed and sent to district superintendents to 
determine the costs involved in implementing each of the three coiurses. 

Additional part-time consultants were employed for a period of two weeks to 
assist in the administration of the speaking tests. The four field consultants 
completed their terms of service on June 30th. 

July 1 - September 30. 1965 . During this period, the major activity 
involved the processing and card punching of data. Due to the magnitude of the 
card punching task, a subcontract for this purpose was initiated with the 
California State Department of Motor Vehicles. Upon the completion of card 
punching. System Development Corporation began analyzing the data from the 
listening and reading tests. The processing of the speaking tests was begun, 
and the judges were hired and trained to achieve the necessary interjudge 
reliability. 

Klaus A. Mueller, co-principaJ. investigator of the project, joined the 
staff of the University of California at Berkeley in September. For purposes of 
maintaining continuity, Mr. Mueller became a consultant to the project. 

Dr. Ray L. Sweigert, Jr., the research consultant with the project, assumed the 
role of co-principal investigator. 

October 1 - December 31, 1965 . Major activities consisted of the continued 
analysis of data and the scoring of the speaking and writing tests. A preliminary 
analysis was conducted using the results of the midcourse examination. 

January 1 - June 15, 1966. The writing of those sections of the final report 
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which did not depend upon the analysis of data was begun early during this 
period. The scoring of speaking and writing tests was finished. 

Upon the request of Donald W. Johnson, Director of the project, the 
U. S. Office of Education granted an extension of time for the completion of 
project activities. This action was necessitated because the complexity of 
several activities involved greater amounts of work and, consequently, longer 
diiration than was originally anticipated. The remainder of this period was 
devoted to the completion of data analysis and the preparation of the final 
report . 



PART I. 



METHODOLOGY 



Chapters 2, 3, and k are concerned with t>e 
methodology of the study. Chapter 2 deals specifically 
with sampling procedures, data collection and data analysis. 
Chapter 3 is concerned with a description of independent 
variables and the way each was measured. Independent 
variables are subdivided into student, teacher, classroom, 
and district variables respectively. 

Chapter U is concerned with dependent variables, that 
is, with student achievement in a variety of skills. This 
chapter contains a description of each of the subtests con- 
structed for the study, the procedures employed in test con- 
struction, and methods of scoring the several tests. 



CHAPTER II 



PROCEDURES 



Sampling of Classes 

represen“tive'a^Ile^of^^f?‘^ necessary to include a 

random sampling procedure^s^uMr*^°i+h’^°/fJ^®^ requirement, a stratified 

® ^ used, with sixth-grade classes as the sampling unit, 

all districts the Spanish Research Project was sent to 

were aufflcient?^*?^?^"" el^entary grades. Of 766 districts in the state, 6 k 

of participation wss also LterainL’’bv''tr Th® nature 

district could decide trinlM^» cf ? the local school district. For example, a 
of the three Snsnlsh v, 4 classes in any one or In any ccmibination 

tual classH fn^^f offered in the project. Furthermore, the ac- 

however, everTeffort ™s mSe **'® district. Within these limitations, 

state as posable. '”® “ representative of the 

Stratification by District Vari able s 



most Mke^v'^o b®" *®™® °f three variables which were presumed 

the distSct in“ter^ appreciable effect on Instructional programs: the size of 

wealth of the district in tei^%f\he i“ the elementary grades; the 

and the population density of the state aid received 

...ic 'i, .4 

trlctrwerfLfLed^ifttoL’^ftf ®® 1®'’®®- SmaU dis- 

level lesrtharoon “ average daily attendance at the elementary 

2S.“ •"”*“» „‘s: 

eeived’by’'tS*dlsLlcr''wh\.“®*j;^®? determined by the kind of state aid re- 

ii£~: f:-“— 

4. . u.„u. z .0 srL,- 



SupplGniGntal aid is furthar s'ta'ta assistance fn 
valuation per unit of average dally attendances below ^spLifie^a^e^®^t 
proportionate to the amount of tax in excess of a standard r^. 

wealt^rthf "hoof di^trie^wllh ®®®"® *>'® 

the wealthiest, thoLf ^c^e^^oth b^sL'L^ „ ®*f ^ ®® 

wealthy, and those receiving supplemental aid in addition to tL" bf 
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equalization allowances as the least wealthy districts. 

The variable of population density was cut into a trichotomy forming metro- 
politan, urban, and rural categories. A metropolitan school district was defined 
as one located within a city having 50,000 or more inhabitants, or one located 
within one of two cities having contiguous boundaries (within 20 miles of each 
other) and constituting, for general economic and social purposes, a single com- 
munity with a combined population of at least 50,000, the smaller of which had a 
population of at least 15,000. An urban school district was defined as one not 
qualifying as a metropolitan district, but which was located in a population cen- 
ter, incorporated or not, of 2,500 or more inhabitants, or one located in the 
densely settled urban fringe of a metropolitan center. Rural school districts 
were defined as all those that failed to qufiJ.ify either as urban or metropolitan. 

These three variables, size, wealth, and population density, were used to 
construct a twenty-seven-cell matrix which provided a basis for the stratifica- 
tion of school districts. The listing unit in the sampling was the sixth-grade 
class, and all of the classes that fell into a particular cell were enumerated. 
Table 1 shows the distribution of districts in the matrix. 

The procedure used to select classes for the sample was a form of proportion- 
ate stratified sampling. The average daily attendance (ADA) in elementary grades 
for school districts throughout the state was computed for each cell in the matrix. 
For every five per cent of statewide average daily attendance in the elementary 
grades represented in a particular cell, one class was drawn randomly from those 
available. This procedure was designed to assure a sample as nearly representa- 
tive of the statewide distribution of ADA in the elementary grades as possible. 
Table 2 shows the model distribution of sample classes based on this rationale of 
selection. For those cells in which less than five per cent of ADA was represent- 
ed, no classes were drawn for the sample. 

To allow for the possibility of attrition among sample classes, an alternate 
sample of classes was selected on the same basis as the primary sample. Alternate 
sample classes were used to replace sample classes that were dropped from the study 
for some reason. 

A total of 337 classes were made available to the project in the 6k districts 
that volunteered. Of these, 210 classes selected instruction by UAE, 93 classes 
selected MLA materials, and 3^ classes selected SPA. Table 3 shows the distribu- 
tion of available classes according to district classification. 

It is obvious that sampling was not possible in some cells. For example, the 
model distribution of sample classes called for one class from a small, rural dis- 
trict receiving basic state aid. It can be seen in Table 3 that there was only 
one class available using MLA and one using Spanish A. Consequently, no sampling 
was possible. However, there were five classes using UAE, making it possible to 
randomly select one of the five classes. 

The model further indicated that five large, metropolitan classes receiving 
equalization state aid should be selected. It can be seen in Table 3 that there 
were only four such classes using SPA available. Thus the sample was of necessity 
short one class in SPA. For each of the other two courses, however, it was pos- 
sible to select 20 sample classes distributed in accordance with the model. 

It is obvious from the table that it was impossible to select a complete 
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alternate sample in any course of instruction except UAE. SPA in particular pre- 
sented problems in this respect. Since only 3^ classes using SPA were available 
for sampling, edl of those not selected for the primary sample were considered 
as alternates. 

Subsampling for Speaking Skills 

The battery of speaking tests had to be administered individually to students. 
The length of the tests and the necessity for individual administration made it 
virtually impossible in the time available to give the tests to every student in 
the sample. Therefore, it was decided to select 10 per cent of the primary sample 
in each course to receive the speaking tests. 

Class lists were used to make this selection. Through application of a table 
of random numbers, 60 students were selected from among those students listed. 

It was not desirable, however, to subsample among classes using SPA because 
it was impossible to predict what students would finish the program by the end of 
the instructional year. As it turned out, only a little more than 10 per cent of 
the students in SPA classes finished the program, making it advisable to test all 
of them. This procedure introduced the bias of student "self-selection" into the 
results, yet to test students who had not finished the program was not considered 
practical or meaningful. From the standpoint of course objectives, it was not 
defensible to test students who had not finished the SPA program, since course 
objectives were specified only for students who covered all the material. 

Attrition 



During the year, a total of thirteen classes were lost to the sample, of 
which it was possible to replace eight. 

In MLA, five classes were dropped from the sample, and three were replaced. 
All three of the MLA classes replaced were in the Los Angeles area. One of these 
was dropped very early because it turned out to be a combination fifth and sixth- 
grade class with relatively few sixth graders, some of whom had taken Spanish 
previously. The other two classes, both in the same district, were replaced quite 
late in the instructional year when it became apparent that there was an irrecon- 
cilable conflict between the district's policy regarding the length of time that 
could be .devoted to testing and the length of time required for testing in the 
project. There was another sample class using the UAE course in this district 
which was dropped for the same reason. 

In UAE, seven classes were dropped from the sample, and four were replaced. 
One of the television classes withdrew from the project because the district 
found it was unable to receive the UAE program properly. Still another UAE class 
was eliminated because it was found that most of the students had previously 
taken some Spanish. Four other UAE classes were dropped from the sample because 
they were located in an area in which the TV program was broadcast only twice a 
week, rather than the prescribed three times. One UAE class dropped was mentioned 
in the last paragraph. 

Only one class in SPA was eliminated from the sample, and this was because 
the class was disrupted when new district boundaries were created and many of the 
students had to be transferred to a new school. This class was replaced. 

In most cases where a class was eliminated from the sample, it was possible 
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to substitute another class which was identical in terms of sampled characteris- 
tics* However, three of the UAE classes which were lost to the sample were not 
replaceable because they happened to fall in a category in which there was an 
insufficient number of suitable alternate sample classes. This was the category' 
of large, metropolitan districts receiving equalization support from the state* 
There were two MLA classes as well that were lost to the sample so late in the 
year that it was impossible to replace them* These two were also in this same 

category of large, metropolitan districts receiving equalization support from the 
state* 

Another kind of attrition which had to be dealt with was that of individual 
students who dropped out of sample classes* A related problem was what to do 
with students who transferred into classes* It was decided that where the number 
of students transferring in or out of a class was not abnormal, it would be re- 
tained in the sample, and the students who transferred in or out would be excluded 
from the analysis of data. 

At the end of the year of instruction, there were 18 sample classes in MLA, 

IT in UAE, and 19 in SPA* The shortages in UAE and SPA were all from large, metro- 
politan districts receiving state equalization aid* It has already been noted 
that there were only four classes in SPA available from districts of this type, 
and the three sample classes lost in UAE were not replaceable* 

Methods of Data Collect ion * 



For each method of instruction, data were collected on Independent variables 
of student, teacher, classroom, and district characteristics, and on dependent 
variables of student achievement, A detailed discussion of the Independent vari- 
ables Is given in Chapter 3; in Chapter k the dependent variables are treated in 
detail* 

Collection of Independent Variable Data 

Most of the data on student characteristics was collected by use of a stud- 
ent information form filled out by participating teachers* In addition, field 
consultants administered a pretest of Spanish listening comprehension and student 
and teacher attitude questionnaires to classes in their respective areas prior to 
the beginning of instruction* 

Data on teacher background characteristics were obtained through a self-report 
form distributed to teachers late in the school year* 

Data on classroom characteristics were recorded on observation checklists by 
the field consultants , who visited each classroom in their areas at intervals dur- 
ing the school year* A special class visit report form was used; each method of 
instruction required the use of a unique form, with data to be collected appropri- 
ate to that method* 

District characteristics were discussed in the section on sampling procedures* 
Data on cost and time factors were collected through a questionnaire mailed to dis- 
trict superintendents* 

Collection of Data on Dependent Variables 




Student achievement in Spanish was measured in the middle of the year 



lU 



(midterm tests) and at the end of the year (final tests). The four field consul- 
tants administered all tests except in speaking. They were assisted in adminis- 
tering the speaking tests by other members of the project staff. 

Midterm tests covered only listening comprehension and were administered in 
group settings. MLA and UAE teachers notified the field consultants when their 
classes reached the midpoint of the course, and the midterm tests were then admin- 
istered. It was impossible for the field consultant to administer the SPA midterm 
to single students as they reached the middle of the program, so SPA teachers con- 
tacted the consultant when several students were at the midpoint, and the tests 
were administered to small groups. 

The administration of all final tests, except speaking, was carried out in 
group settings at the end of the school year. Speaking tests were administered 
individually by field consultants, other project staff members as needed, and 
personnel from System Development Corporation. Due to the lengths of the various 
speaking tests, a subsample of UAE and MLA students and all SPA students com- 
pleting instruction were given these tests. (See page 12 for a discussion of 
the UAE and MLA subsampling procedures.) 

Each student in the subsample received the full battery of four speaking 
tests in one day. If the tests had been administered over more than one day, 
there would have been the risk of absences, resulting in partial data. With this 
system, one test administrator was able to give tests to two students at one school 
per day. The testing was staggered between the two students to avoid excessive 
fatigue (i.e., while student A was taking the first test, student B was with his 
class; at the end of test 1, student A returned to class and B received test l). 
This alternating procedure continued until all four tests were completed by all 
students. To further reduce the possibility of test fatigue, the test procedures 
included a one-minute rest period approximately every 15 items and a five-minute 
rest period about every 30 items; however, in practice, some test administrators 
allowed students to skip the rest period if they preferred to do so. There were 
several cases where students who could matke very few responses to test items be- 
came upset. These tests were usually terminated before being completed. 

All independent and dependent variable data were punched on data processing 
cards. Student responses to each item of the listening and reading tests were 
pxmched directly from answer sheets; writing and speaking responses were first 
analyzed by judges, and the judges' scoring of each Item was then punched. 

Methods of Data Analysis 

After the data for independent and dependent variables had been collected, 
the following analyses were performed: 

1. Summary statistics for each criterion-referenced test. The means and 
standard deviations for each test were computed, as well as the mean 
value as a percentage of the maximum possible score for a given test. 

2. Frequency distributions for each test. The percentage of students who 
achieved within each decile interval was computed for each test. 

3. Intercorrelations among all tests. For each method of instruction, an 
Intercorrelation matrix was computed showing the interrelationships 
among all achievement tests. (These were product -moment correlation 
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coefficients. ) 

Correlations between independent and dependent variables. Tables of 
correlation coefficients were computed showing the relationships between 
independent variables (grouped as student, teacher, classroom, €«id dis- 
trict characteristics) and student performance on all tests. (These were 
product-moment correlations.) 

5» Multiple regression analyses. Multiple correlation coefficients were 
calculated involving a number of different subsets of independent vari- 
ables and all dependent variables. For each method of instruction the 
subsets were; (a) selected student variables; (b) selected teacher vari- 
ables; (c) selected class variables; (d) variables from all three cate- 
gories selected as a"good"subset by a computer program; and (e) variables 
from all three categories selected as an "interesting" subset by the 
experimenters. (These were product-moment multiple correlation coeffi- 
cients. ) 

6. Analyses of student attitudes. Attitudes (interest and confidence) of 
students were measured before and after the year's instruction. Means 
and standard deviations were determined. In addition, the product— moment 
correlation between before and after measurements was calculated, and 
^ - tests for differences between correlated means were computed for each 
attitude. 

T. Analyses of individual test items. For every item in each test, the per- 
centage of students responding correctly was determined. 

8 • Analyses of achievement by classrooms. For the UAE and MLA methods , 
means were calculated for certain independent and dependent variables 
within each class. Classes were ranked and con^ared. 

Elimination of Students with Previous Spanish 

Since this study was intended to gain information on achievement in Spanish 
from students who were naive in regard to the language, it was necessary to screen 
from the analyses those students who already possessed considerable knowledge of 
Spanish. Three measures of student characteristics could have been used as screen- 
ing devices: amount of Spanish training the student had already received, whether 

or not the student was a native speaker of Spanish, and the student's score on the 
pretest of listening comprehension. After consideration of each measure, the pre- 
test was selected because its content was most closely related to the objectives 
of the various instructional materials, making it the most valid discriminator be- 
tween students who were and were not knowledgeable in Spanish. 

A cutoff score of 50 per cent on the pretest was used to divide students into 
experienced and inexperienced categories. It was felt that any student scoring 
higher than 50 per cent (e.g., 31 or greater) already possessed much of the in- 
formation to be covered during the year's instruction. Accordingly, those stud- 
ents who scored less than 31 on the pretest were included in the analyses of the 
results, and the rest were not. 

A total of 101 MLA students and 39 UAE students were classified as experienced 
on the basis of the pretest. In order to determine whether these students differed 
from those classified as inexperienced within each method, the two groups were 
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compartd on a number of variable*, such as intelligence, reading ability, age, 
and attitudes toward learning Spanish. In no case did the two groups differ, 
indicating that the inexperienced students, on whom all analyse* were conducted, 
did not represent a biased sample of sixth graders. 

Only two students among the 55 who completed the SPA course exceeded 50 per 
cent on the pretest. These two scud»)nts were not eliminated from the analysis of 
the data since the SPA sample already was so small and the two students scored 32 
and 33. 
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CHAPTER III 



INDEPEKDENT VARIABLES 

Independent variables fell into three general categories: student, 

teacher, and classroom variables. Each will be defined, and its measure- 
ment discussed in turn. 



Student Variables 



All student variables, with the exception of whether or not Spanish was 
spoken regularly in the home, were measured in terms of information included 
in the student's cumulative folder on file in the school. A copy of the in- 
strument used to record student data may be found in Appendix D. 

I£. IQ was considered to be a reasonable measure of mental ability. 

IQ scores from tests administered during the fifth grade as part of the state 
testing program were available. Schools were requested to report the results 
of intelligence tests in terms of IQ as such, rather than in terms of stajiines, 
percentile bands, etc. 

Because the short form of the California Test of Mental Maturity was used 
more widely than any other intelligence test, it was decided to administer 
the CTMM to students in those districts that had received some other test under 
the state testing program. By so doing, comparable intelligence test data were 
obtained for most students. Only IQ scores from the CTMM were included in the 
analysis. 

Reading Grade Placement . Reading achievement was measured in terms of 
achievement tests given to fifth-grade students under the state testing pro- 
gram. The test used most frequently was the California Achievement Test. 

Other reading tests which were used by schools in the project were the Iowa 
Tests of Basic Skills, Metropolitan Achievement Tests, Sequential Tests of 
Educational Progress, Science Research Associates Achievement Tests, and the 
Stanford Achievanent Tests. Reading achievement results were obtained in the 
form of grade placement scores. 

Grade P oint Average . Grade point average was measured in terms of the 
average of the subject letter grades (converted to a nine-point scale) received 
by the student in the fifth grade. 

Parent's Occupation . To measure this variable, a modified Warner scale, 
using nine occupation categories, was used for both the student's father and 
mother. The scale was applied by the student's teacher in reference to 

occupational information about the student's parents included in the c\imula- 
tive folder. 

Previous Training in Spanish . In order to identify those students who had 
studied Spanish at some prior time, a scale was constructed to measure the 
amount of previous training that a student had received. The scale had four 
categories, from "at least two years of Spanish” to "no foreign language 
training." 

Spanish Spoken in Home . It was considered important to know whether or 
not Spanish was spoken regularly in the student's home. Teachers obtained this 
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information from the student. 

Sex and Age . The student's sex and age in months were also recorded. 

Interest and Confidence . Scales were devised to measure the student's 
interest in learning Spanish and his feeling of confidence that he was able to 
do so. Each scale contained five attitude questions and was administered both at 
the beginning of Instruction and at the end, using the same questionnaire with 
appropriate changes in verb tense. A copy of the attitude measuring instrument 
for students may be found in Appendix D. 

Teacher Variables 



Teacher variables were measured by questionnaire, a copy of which may be 
found in Appendix D. The teacher's attitude toward teaching Spanish to sixth 
graders and perceived enjoyment in teaching a project class were measured both 
before and after instruction, using the same instrument with appropriate changes 
in verb tense. A copy of the teacher attitude questionnaire may be found in 
Appendix D. 

Spanish Training . To measure the teachers' training in Spanish, a six- 
point scaJLe was used, from "native language is Spanish" to "no academic train- 
ing in a foreign language." 

Experience Teaching Spanish . This variable was measured by a four-point 
scale, from '*at least five years' experience as instructor in the speaking of 
Spanish" to "no experience as instructor in the speaking of a foreign language." 

Fluency in Spanish . This was measured on a three-point scale: "little 

or no fluency," "some fluency," and "native or near-native fluency." 

Age and Sex . The teacher's age was measured in decades ("20s" through 
"60 or more" ) , and sex was recorded. 

Attitude Toward Teaching Spanish to Sixth Graders . This variable was 
determined by a four-point scale, from "it is extremely worthwhile" to "it 
should not be undertaken." 

Perceived Enjoyment in Teaching a Project Class . This variable was measured 
by a five-point scale, from "very much" to "not at all." 

Classroom Variables 



Whereas the student and teacher variables were relatively easy to choose 
and to measure, the selection of appropriate classroom variables and the construe 
tion of indices was a more difficult task. 

Measurement of classroom variables began with preliminary observations by 
the field consultants and the construction of an observation checklist from these 
data. The observation checklist was revised once. Subsequently, the field con- 
sultant filled out a copy of the checklist for each visit to a class. 

Field consultants were instructed to visit each class about once every two 
weeks. After the first one or two visits, the field consultant would drop in 
unannounced to see the class, unless the local school administration objected to 
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unannounced visits. 

At the end of the instructional year, the observation checklists for each 
class were used in the completion of a composite class visit report intended 
to reflect the central tendency of the periodic observations. Some of the class- 
room variables measured were common to more than one course of instruction. 

Others were peculiar to a particular methodology. Copies of the class visit 
report forms for each course may be seen in Appendix D. Only those factors are 
discussed here on which there was sufficient variability for analysis. Non- 
variable classroom factors may be identified through examination of the class 
visit report forms. 

MLA Classroom Variables 



Use of Supplementary Materials . Teachers were requested to adhere as 
closely as possible to the course guide, but were given the freedom to intro- 
duce other materials if they perceived a particular need. The use of materials 
to supplement the regular program was measured on a nominal scale, i.e., either 
the teacher used supplementary materials at some time during the instructional 
year or she did not. This scale was applied separately to a number of different 
types of materials as listed below; 

1. Visuals 

2. Records or tapes 

3. Songs or games 
Films or film strips 

5. Text materials 

6. Tests 

Teacher's Use of English in the Spanish Class . This was a measure of how 
often the teacher spoke English in the Spanish class, recorded on a four- 
point scale from "rarely" to "almost always." 

Students* Use of English in the Spanish Class . To measure the frequency of 
the students' use of English during the Spanish lesson, a four-point scale from 
"rarely" to "almost always" was used. 

Teacher Serves as Speaking Model for Spanish . This was a measure of the 
frequency with which the teacher modeled Spanish utterances for the students. 
Alternatives to teacher modeling, of course, were to rely on records or on 
students, particularly students whose native language was Spanish. This variable 
was measured through use of a five-point scale from "almost always" to "never." 

UAE Classroom Variables 



The following classroom variables were measured for UAE classes. 

Warm-up Sessions . The course guide prescribed a warm-up session prior 
to each Spanish telecast. This variable was measured on a nominal scale, i.e., 
whether or not the teacher usually held a warm-up session prior to the tele- 
cast. 



F ollow-up Sessions . A follow-up session after the Spanish telecast was also 
prescribed by the course guide. This variable also was measured on a nominal 
scale. 
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Student Partici'pation * This was a measure of the proportion of the class 
that answered the television instructor when she cal.led for choral responses, 
recorded on a four-point scale from "most of the class" to "none." 

Teacher Response to TV Instructor . This was a measure of whether or not 
the classroom teacher generally responded along with the students in drill 
conducted by the television instructor. It was recorded on a nominal scale 
{ yes or no j . 

Teacher's Use of English in the Spanish Class . On days when there was no 
Spanish telecast (every other day), the clas^sroom teacher conducted a review 
of previous lessons. A measure was taken of the frequency with which the teacher 
spoke English during this review. It was recorded on a four-point scale from 
"rarely" to "almost always." 

Students* Use of English in the Spanish Class . This was a measure of the 
frequency with which the students used English during the Spanish lesson on 
days when there was no Spanish telecast. It was recorded on a four-point 
scale from "rarely" to "almost always." 

Teacher Serves as Speaking Model for Spanish . This was a measure of whether 
or not the classroom teacher modeled Spanish utterances for the students during 
the Spanish review session on days when there was no telecast. It was recorded 
on a nominal scale ("yes" or "no"). 

SPA Classroom Variables 



The following classroom variables were measured for SPA classes. 

Use of Supplementary Materials . The use of materials to supplement the regu- 
lar program was measured on a nominal scale, i.e., either the teacher used 
supplementary materials at some time during the Instructional year or she did • 
not. This scale was applied separately to a number of different types of 
materials as listed below: 

1. Visuals 

2. Songs or games 

3. Films or film strips 

Other Activity in Classroom During Spanish Lesson . This was a measure of 
whether or not there was usually other activity going on in the classroom while 
some students were using the programmed materials. It was recorded on a nominal 
scale ("yes" or "no"). 

Teacher Supervision of Students Using Materials . Also measured on a nominal 
scale, this variable referred to whether or not the classroom teacher supervised 
the students using the programmed materials. 

Availability of Tape Recorders . This was a measure of whether or not the 
students had access to tape recorders and materials other than during the regular 
class sessions. It was recorded on a nominal scale. 

Use of Display Sessions . Classroom teachers were advised in the course 
guide to hold display sessions for small groups of students who had reached 
approximately the same place in the program. These sessions were to provide 
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iMguaKe sLll^ the students to demonstrate and reinforce their newly acquired 
play ^ measure of the frequency with which dis- 

about once held. A three-point scale was used: about once a week; 

every two weeks; about once a month or less. 

District Variables 

in ChaDter^rin^^f.^r °f Population density were discussed 

sizro? tL SI /f f stratification of classes for sampling. The 

TTTpTTnn^nr “ le"»s of elementary ADA and the wealth of the district 

in ihrcaiifornla^t f f /il j-eceived were statistiJTliSdily available 

from cen^i S °®P"^ment of Education. Population density was taken 



o 



CHAPTER IV 






DEPENDENT VARIABLES 

This chapter describes the tests and testing procedures developed for use 
in the project. 

Rationale for Criterion-Referenced Testing 

Tlie criterion-referenced testing approach used in this study represents a 
basic departure from the usual normative testing methods. Normative testing 
samples from the content of a subject matter area and yields a relative rating 
of overall student performance. This approach, as typified by present-day 
standardized exams and teacher-constructed classroom tests, indicates that one 
student is more or less proficient than another but provides little information 
about (1) how much of the total content of a course of instruction was achieved 
by any of the students, (2) which specific objectives each student achieved, and 
n) how realistic the course objectives were for the conditions under which 
instruction took place. 

In contrast to normative testing, the aim of the testing in Project D-ITT 
was to measxxre the total linguistic objectives of a foreign language course 
(i.e., every lexical and grammatical element which the course authors expected 
the student to control at the end of the instructional period). This approach, 
which has been called criterion-referenced testing,! depends on an absolute 
standard of quality as contrasted with norm-referenced testing which depends on 
a relative standard. Unlike normative testing, in which the difficulty level of 
items is manipulated deliberately to produce a wide distribution of scores, 
criterion-referenced testing seeks to discriminate between studnets who have had 
a specific training ^d those who have not had that training. No attempt is made 
to arbitrarily maximize discriminations among students who have all had the same 
training. 

Criterion-referenced tests were not viewed as an aid for comparing different 
instructional methods, but as a tool for improving any instructional course — a 
tool capable of providing more extensive and precise data on which to base 
revisions of materials, preparation of new materials, changes in teaching proced- 
ures or learning conditions, and changes in course objectives. 

Criterion-referenced testing, in providing more explicit and extensive data 
on the extent to which stated course objectives have been achieved, can furnish: 
(1) an important index for determining how serious the need for change is; (2) a 
point of departure for systematic atten^ts to determine what to change; and (3) 
a sound basis for effective articulation of instruction. 

Criterion-referenced testing, however, is much easier said than done, 
especially in the area of foreign language instruction, where objectivity in 
testing the speaking skill has been a particiaar problem. As far as can be 
determined, the California Spanish Research Project D-17T is the first applica- 
tion of the technique of criterion-referenced evaluation to a large scale field 



1 Glaser, Robert. Instructional Technology and the Measuring of Learning 
Outcomes: Some Questions, American Psychologist . August 1963, 18 (8), 519 - 521 . 



o 

ERIC 

hiaifiiifftaiTiTiaa 



22 



23 






test. As a pioneering effort, one of the purposes of this study was to investi- 
gate the feasibility of developing and administering such tests. Within the 
existing time constraints (the project was funded in June 196U, and all tests for 
the three language courses had to be ready for administration by May 1965), we 
wished to see how far we could extend the limits of comprehensiveness and object- 
ivity in foreign language testing. The results of this effort— the problems as 
well as the products— are discussed in the following pages. 

Description of Tests 

The tests were designed to measure achievement in the four basic language 
skills which the students were expected to acquire (i.e., listening comprehension, 
speaking, reading, and writing) at the end of the first year of language instruct- 
ion. All three language courses were part of a continuing sequence of instruction 
that went beyond the first year. MLA, SPA, and UAE had listening comprehension and 
speaking as objectives, but differed in specific content and emphasis. MLA and SPA 
had both vocabulary and grammar objectives during the first year. UAE emphasized 
vocabulary and expressions in the first year, introducing specific grammatical ob- 
jectives in the second year. Only SPA taught reading and writing in the first year. 

The tests were concerned mainly with the two important ingredients of the 
basic language skills: control of vocabiilary and of grammatical structure. The aim 
was to accomplish this measurement in a highly objective manner which would provide 
data that was both useful and easily interpretable . To meet this objective, it was 
necessary to isolate each component of language proficiency for individual evalua- 
tion (that is, the four basic skills, and vocabulary and grammar within each skill, 
were tested independently of each other). 

For each of the four skills, a separate test was developed in which the in- 
fluence on performance of any of the other skills was either greatly reduced or 
completely eliminated. For each skill, there were separate tests for vocabulary 
and grammar in which one aspect was held constant while the other was tested. • 
Pronunciation was tested independently of the other aspects of speaking. In the 
vocabulary and grammar tests only one word or grammatical element was tested per 
test item. Any errors in the student response not affecting the element being 
tested were ignored in the scoring. Each test item was scored as right or wrong. 

A scoring system was developed for the oral grammar test which attempted to change 
the judge's role from subjective decision-making to objective rule-following.^ 

Since each test item represented a course objective, the total number of 
correct responses (i.e., the student's final score) was a measure of the total 
number of specific vocabulary or grammar objectives achieved for each skill. 

The tests in this project were designed to evaluate control of vocabulary and 
structure under certain limited conditions. Conversational fluency was not being 
evaluated. The final scores, therefore, do not permit judgments about a student's 
ability to comprehend or to carry on a sustained conversation in Spanish. No tests 
were developed to evaluate cultural and other course objectives (e.g., learning of 
songs, memorization and performance of dialogues). It should be noted that learn- 
ing of songs and verses was an important objective of UAE in the first year. It 
was not evaluated because of the lack of time to develop appropriate instruments 
and procedures. 



2 The scoring procedures for all tests and the role of the judge in scoring 
the speaking tests are discussed in detail on p. Ul. 
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The specific tests developed for each language course are listed in Table h. 

The fact that the same aspects of each language skill (e.g., vocabulary, grammar) 
were not tested for each language course, reflects differences in specific object- 
ives of the courses. Although the same test format and scoring procedures were some- 
times used for more than one course, the content of the tests was different in all 
cases. Thus there were 28 different tests, 8 for MLA, l6 for SPA, and k for UAE.3 

In addition to the criterion tests, an attitude questionnaire was prepared. It 
was administered before and after instruction in an attempt to measure the effect of 
instruction on the student's interest in learning Spanish and on his confidence in 
his ability to learn this language. The same questionnaire was used for all three 
language courses. In the remainder of this section, the individual tests are 
described in detail. 

Listening Comprehension Tests 



Listening comprehension refers to the ability of the student to respond 
appropriately when presented with an audible Spanish utterance. 

Recognition of vocabulary and grammatical signals was tested separately. The 
grammar test evaluated control of both syntax and morphology. Syntax regers to 
sentence formation~the sequence and arrangement of words to make up larger units of 
speech such as phrases, clauses, and sentences. Morphology refers to word formation- 
-the types and arrangements of stems and affixes that make up words. The grammar 
transfer test dealt only with syntax. It tested the same syntax patterns as the 
grammar test, but where the latter used Spanish stimuli taken directly from the course 
content, the former used a recombination of these stimuli. Instructions and test 
items were presented to the students by tape recorder to insure uniform conditions 
of test administration. The voices on the tapes were those of native speakers of 
Spanish, speaking at a normal rate of speed. The amount of time provided for student 
responses was intended to give all students an adequate opportunity to answer every 
item. The time varied for each item, ranging from 7 to 10 seconds. Initially, 
these times were based on the length and type of stimulus and of response alterna- 
tives from which the student had to select. The times were revised on the basis of 
experimental tryouts of the items. Following is a detailed description of each of 
the tests. 

1. Listening Con^rehension Vocabulary Tests (MLA, SPA, UAE).^ 
a. Stimulus characteristics. 

Each item consisted of a single Spanish utterance taken from the 
language course. Only one word was tested in each item. Each Spanish 
utterance was spoken twice. 



b. Response characteristics. 

The student responded by selecting from multiple choice answers in 
a test booklet. Either pictures or printed English alternatives were 
used in vocabulary test items. ^ 



3 A complete set of tests, answer booklets, instructions for administering 
and scoring guides for speaking and writing tests is available in a supplement to 
the final report of the project. 

^ The courses in parentheses are the ones for which a test was developed. 

5 See page 29 for discussion of rationale for using English alternatives. 
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TABLE h 



LIST OF TESTS 



Test 


Language Course* 


MLA 


SPA 


UAE 


Listening Comprehension 








Vocabulary 


X 


Y 


Z 


Grammar 


X 


Y 




Grammar Transfer 


X 


Y 




Speaking 








Expression 






z 


Vocabulary 


X 


Y 




Grammar 


X 


Y 




Grammar Transfer 


X 


Y 




Pronunciation 








Mimicry 


X 


Y 


z 


Constructed Response. 


X 


Y 


z 


Oral Reading 




Y 




Reading Comprehension 








Vocabulary 




Y 




Grammar 




Y 




Grammar Transfer 




Y 




Writing 








Vocabulary 




Y 




Spelling 




Y 




Grammar 




Y 




Grammar Transfer. 




Y 





*Each letter (X,Y, or Z) indicates that the test was developed for the 
language course indicated. The letters X, Y, said Z are used to indicate 
that the tests of a particular skill were different for the three courses. 
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(l) Test items using picture responses. 

Pictures were used for every lexical item which could he tested 
by this means (37 percent in MLA^ 50 percent in SPA, and 57 percent 
in UAE); all other items lised printed English alternatives. Most of 
the words tested by pictures were concrete nouns , action verbs , and 
descriptive adjectives. All pictures were pretested with English 
stimuli . 

The student had four possible choices — the first three were 
pictures and the fourth was "I don't know." The student was told 
that one of the three pictures was always correct but that if he 
had no idea which was the right answer he was to choose the fourth 
alternative. The "I don't know" option was added to avoid long 
delays in responding when the student was in doubt. 

Sample Item 

The underlined word in the Spanish utterance, meaning "man," 
was being tested. The Spanish stimulus heard by student was "El 
hombre duerme." The response choices were: 



A B C D 




(2) Test items using English responses. 

The student had to select the English sentence which was nearest 
in meaning to the Spanish he heard. There were four choices — A, B, 
and C were possible correct answers and D was "l don't know." 

The choices represented the exact same grammatical pattern and 
Included the same vocabulary except for the one word being tested. 
Each item was so designed that a correct response depended on the 
student's comprehension of the single word being tested. 

Sample Item 

The underlined word in the Spanish utterance, meaning "We have," 
was being tested. The Spanish stimulus heard by student was 
" Tenemos un gato." The response choices were: 

a. We want a cat. 

b. We have a cat. 

c. We see a cat. 

d. I don't know. 



o 
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2. Listening Comprehension Grammar Tests (MLA, SPA). 

a. Stimulus characteristics 

Each item consisted of a single Spanish utterance taken from the course 
of study. Only one grammatical element (either syntax or morphology) waa 
tested in each item. Each Spanish utterance was spoken twice. 

b . Response characteristics 

The student selected from three printed English sentences the one which 
most nearly approximated the meaning of the Spanish utterance or indicated 
that he didn't know the answer. 

In order to make sure that the alternatives forced a decision based 
on the grammatical point being evaluated all other aspects of the choices 
(vocabulary and morphology or syntaj^were kept as constant as possible. 

Sample Item; Syntax 



The item tested for recognition of correct word order within the 
following pattern; noun phrase as subject, transitive verb, noun 
phr^e^^as direct object. The Spanish stimulus heard by the student 
was. Los nifios tienen mi oso.** The response choices were; 

a. bear has the little boys. 

b. They have my little boy's bear. 

c. The little boys have my bear. 

d. I don't know. 

Sample Item; Morphology 

The item tested for recognition of the third person singular form, 
present tense, of the verb "salir." The Spanish stimulus heard by the 
student was; Sale de la casa." The response choices were; 

a. We're going out of the house. 

b. I'm going out of the house. 

c. He's going out of the house. 

d. I don't know. 



3. Listening Comprehension Grammar Transfer Tests (MLA, SPA). 



^ Each item tested a syntax pattern included in the grammar test; however, 
in the transfer test the Spanish utterance was not taken directly from the 
co^se. All of the lexical and grammatical elements, were in the course but 
^t necessari^ in the form used in this test; in all other respects, the 
^a^ar ransfer test was exactly the same as the syntax part of the grammar 

W0S w • 



h. 



Remarks Concerning Listening Comprehension Tests 
Grammar Transfer) . 



(Vocabulary, Grammar and 



a. Difficulty level and discrimination power of test items. 
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Dlstractors (i.e., incorrect response choices) were selected on the' 
basis of their effectiveness in discriminating among students who had 
undergone Spanish instruction and those who had not received any Spanish 
instruction. The aim was to make it as simple as possible for students 
who had taken the Spanish coxirse, and knew the material, to answer the 
items correctly, while making it as hard as possible for students who had 
not received the Spanish instruction to obtain correct answers. Conseq- 
uently, fine discriminations (e.g., minimal contrasts), which could have 
increased the difficulty level for students who had received the Spanish 
instruction, were not used. The following is an example of the type of 
distractor found to be most appropriate for the purposes of this project: 
In testing the word CARNE (meaning "meat”), a picture of a "car" was a 
good distractor for the "non Spanish" students but did not cause diffi- 
culty for the Spanish students. 

b. Control of vocabulary in grammar items. 

Keeping the vocabulary constant in all the response alternatives was 
generally not a problem in items testing morphology. However, in testing 
syntax, it was frequently very difficult to find a third alternative in 
which the English was not somewhat awkward. Much effort was expended in 
revising these third alternatives; however, it was not possible to elimi- 
nate all awkward options. Nevertheless, experimental tryouts indicated 
that these incorrect alternatives were chosen by non Speuiish students and 
therefore did serve to discriminate between them and students who had 
studied Spanish. 

c. Pretesting picture items in vocabulary tests. 

Many of the pictiires, whose meanings initially seemed perfectly 
clear, were found to be defective when paired with English stimuli and 
tested on sixth-grade pupils. Mamy items had to be revised several 
times , and very close contact with the artist was necessary to obtain 
simple and unambiguous pictures. 

d. Presenting the Spanish stimulus twice. 

The spoken Spanish stimulus was presented twice to ensure that each 
student had an adequate opportunity to hear the stimulus. Experimental 
tryouts showed that students were sometimes thinking about the previous 
item, when the new stimulus was first presented, and therefore did not 
hear it the first time. Also, noises in and outside the classroom some- 
times distracted students, causing them not to hear the stimulus the 
first time. 

e. Spanish voices on the test tapes. 

During the first year of instruction, UAE students were exposed 
mainly to a female Spanish voice (non Castilian). The UAE Spanish test 
tape was recorded by a male voice (non Castilian). The SPA programmed 
instruction tape mainly used a male Spanish voice (Castilian). The SPA 
test tape was recorded by a female voice (Castilian). The switch in 
voices on the two test tapes was due to the availability of Spanish speak- 
ing personnel during the recording phase of the project. This is a 



po«*ible ttst limitation; however, the course authors did not believe that 
the change in voice would cause undue interference. 

Use of jSnglish in response alternatives . 

Within the foreign language field there is neither general agreement 
te^tiS^**^”**^"^*^ evidence on the proper use of English in teaching and 



Early in the planning stages of the test development, the project's 
consultant raised some objections to the use of English. How- 
ever, after considering the different possible response alternatives, 

appeared to represent the simplest, 
o? enabling students to indicate their conq)rehen8ion 

of the Spanish they heard. It also provided an effective means for con- 
trolling vocabulary and grammar so that responses could be clearly related 
to knowledge of one particular linguistic element. 

Ihe SPA programmed instruction used English to a considerable degree, 
i^glish equivalents were provided in the UAE teacher's guide for all 

dialogues. The MLA teacher's guide did not contain 
^glish equivalents of the Spanish course content. The extent to which 
English was used in conducting the latter two courses is not known, but 
^servations by field consult^ts suggested that this varied considerably 
m class to class. The authors of all three courses agreed that the 
task of recognizing the English equivalent of Spanish utterances was with- 
in repertoire of the students. They did not anticipate any 

special difficulties. «ujr 



following response modes for test items were considered and re- 

Jected: 

(1) Printed Spanish alternatives. 

Hiis would have enabled the student to stay in one language. 
However, for two of the courses (MLA and UAE) it was not possible 
because the students had not been taught to read Spanish. It was 
not used in the third case (SPA) because it would have meant testing 
reading and listening comprehension in combination, making interpre- 
tation of the results difficult (i.e., if a student missed an item, 
was it due to his not understanding the Spanish he had heard or the 
Spanish he had read?). If an overall score was desired for compar- 
ing students on their combined listening-reading ability, this type 
of item would have been satisfactory. However, for the purpose of 
this project, it was not appropriate. 

(2) Multiple-choice auditory responses in Spanish. 

Another way of staying in the target language would have been 
to have the Spanish stimxaus utterance followed by three oral res- 
ponses in Spanish, with the student selecting the response repre- 
senting the most appropriate reply to the stimulus. There are 
several problems with this type of item. If the student chooses 
incorrectly, it is not certain whether he missed something in the 
stimulus or in the response. This type of item also places a great 
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+ auditory memory. The student must recall the stimulus each 

time he hears a new response and compare it with each response. 

(3) Picture responses. 

In the vocabulary test, pictures were used extensively to test 

descriptive adjectives. The prob- 
associated with using pictures for testing abstract nouns and 

complex to solve within the 
time period available for developing the tests. 

g. Midterm vocabulary and grammar tests. 

Listening tests covering the content taught during the first hai f nf 

IZtTZllJT, the studenL ha^ co^letefthe a^rop! 

(!•«•» MLA lesson 7; SPA lesson 30; UAE lesson U5). When 
the students had completed the entire course, these tests were re-admin- 
istered as the first half of the final tests. The pu^poL ortesti^?he 

to nro^ldra'h °? material, at two different time periods, was 

wL question; As new material 

« 5 course, was the students' 

ntrol of first half content maintained, reduced, or increased? 

Speaking Teats 

nron„!°f »®Parate grammar, vocabulary and 

evS^ief <on?^ofnf^L®r=°”* f Pronunciation. The speaking gra»ar test 
covered onirs™t«v^ both syntM md morphology. The grammar transfer test 
•Kii+ a, A tested the same syntax patterns as in the grammar test 

copses pronun- 

there was also ^ oral reading pronunciation test. As with the “string cowre- 

give all student ^ovided for student responses was intended to 
students an adequate opportunity to answer every item. The time varied 

ITtXTs,^ - -P-i- 

1. Speaking Grammar and Grammar Transfer Tests (MLA, SPA), 
a. Speaking grammar teat. 

In atten^ting to evaluate the student's control of discrete svntax 

patterns and morphological forms, under specified conditions, therrwere 
four main problems: ’ 

(1) How to ^nimize the effect of insufficient control of vocabulary in 
trying to ascertain whether, the student controlled the pattern (i.e 

fan ^ 7 ° ® incorrectly because ^f ‘ ’ 

faille to recall a vocabulary item, rather than because of insuffi- 
cient control of the pattern). msuiri- 

(2) How to septate listening comprehension from speaking. If the stud 
ent responded incorrectly to a Spanish stimulu^, it might have bee^ 

^derstanding the stimulus rather than not controlling 
the grammatical element called for in the response. ironing 
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(3) How to ensure that the student responded to the Spanish stimulus, in 
each item testing a single linguistic element, with an utterance con- 
taining the element being tested rather than an acceptable variant. 

(U) How to minimize or eliminate factors of imagination, or ability to 

think of a reply, when an oral, constructed response to an oral stim- 
ulus was required. 

The following procedures were developed to solve these problems: The 

student response in Spanish was under the control of English instructions 
and a Spanish stimulus presented by a tape recorder. The student was first 
told in English what his response in Spanish should be. These instructions 
were repeated twice. The student then heard the Spanish stimulus, which 
contained all the Spanish words which he needed for his response. (The 
student was told this in advance to encourage him to make use of this voc- 
abulary aid. ) The Spanish stimulus was repeated twice before the student 
atten^ited his response. All student responses represented utterances taken 
directly from the language course. The Spanish stimulus was generally not 
the exact one which was used to elicit the student response in the course. 
Student responses were recorded on a second tape recorder for subsequent 
evaluation by independent Judges. Tests were administered to one student 
at a time. 



Sample Item 

The following item was used to test for agreement between the 
masculine singular subject and the predicate adjective: The student 

heard: 

"Your teacher will say; The ball is yellow. What color is the 

pencil?" 

"You say: The pencil is yellow." 

"La pelota es amarilla. iDe quS color es el iSpiz?” 

Responses accepted as correct were: 

El iSpiz es araarillo^; es amarillo,; amarill^. 

To receive credit, underlined features of the acceptable responses 
had to be correct. 

The following item tested for position of adjective: The stud- 

ent heard: 

"Your teacher will say: Paco has a book. It's blue." 

• f 

"You say: Does Maria have a blue book?" 

"Paco tiene un libro. Es azul." 

Responses accepted as correct were: 

Libro followed by azul or any descriptive adjective; libro or 
any noun (except a proper name) followed by azul. 
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Speaking grammar transfer test. 

grammar test?*^^All the^avnt^ vas the same as the syntax section of the 
tested again* This Patterns tested in the grammar test were 

all the vocabulary needed """ 



c. 



Remarks on speaking grammar and grammar transfer tests, 

s.‘::s.ri2 r,L‘" 

considering «n +ir u n incorrect responses were possible, 

and the nS^er of ^spoLervhl"f 
ite. helow teetel HXTlfZTa 

noun phrase as sublect. verb "to -ho » ^ pattern: 

native. The student heard: ’ as predicate nomi- 

"Your teacher will say; Is Paco a dog or a boy?" 

”You say: Paco is a boy." 

"dEs Paco un perro o un nifio?" 

Responses accepted as correct were: 

Paco es un nifio; Paco es un perro; Es un niBo; Es un perro. 



( 2 ) 



paSflia^cc^rSeriSed ““^rol of the 

Paco niBo; Un = 



Each student response was scored twice fl-rHt or, /n« 4. 

enUrfutt“ra^L“ utterailce. When e^eVon“t“'“" 

as"\“(eT: in^he p“ 

perro would have been incorrect). 6 ^ ^ ^ 

(3) Experimental tryouts of the tests indicated that itf»n.« ^ n 4 

direct discourse fe o- "»Pon inaicaxea that items involving in- 

exr,erience with directed dialo^e in tllZ t^SSns lirert'a"^”^® 
course ( your teacher will say;" "you say") proved®;ore effective' 



(U) 



in theTlLl1esTi1e^e®v“cfpres"^nt:d Se J^gnsh 

SPA; a male voice®p«sented toe 

Spanish. presented the English and female voice gave the 



The scoring procedures are discussed in detail on p. in. 



Speaking Vocabulary Tests (MLA, SPA). 

a. Description. 

This test was designed to see how many of the Spanish words taught 
in the course of study could be recalled and pronoianced sufficiently well 
to be comprehensible to a native speaker of Spanish. The student was 
asked to use the word being tested in a minimal context (i.e., shortest 
utterance in which word was used in the course), to minimize interference 
from deficiencies in other aspects of Spanish or from lack of knowledge 
of other vocabulary. The student response was under the control of an 
English stimulus. The student heard an English utterance twice and was 
asked to respond orally with the approximate Spanish eq.ui valent. For ex- 
ample, the student heard: "It's a table" and was expected to respond "Es 

una mesa." "It's a" followed by a noun was usually used as the stimulus 
with concrete nouns . Where the student response required several words , 
the student was encouraged to say as many words as he knew (i.e., make an 
incomplete response rather than say nothing). For example, in an item 
testing the word "quiere," the English stim\ilus was: "He wants the book. 

If the student responded with "quiere" but omitted "libro," he still re- 
ceived credit for a correct response. The English stimulus was repeated 
twice. Student responses were tape-recorded for later evaluation. 

b. Remarks on the speaking vocabulary tests. 

(1) In the vocabulary test the oral Spanish response was under the con- 
trol of an English stimulus. This represented an important limita- 
tion as far as the MLA course was concerned. Although English may 
have been used in MLA to establish the meaning of Spanish words, it 
was probably rare that English wets used to elicit a Spanish utter- 
ance. The students' use of new vocabulary was generally under the 
control of Spanish stimuli such as "iQu§ hace?" for verbs and "iQuS 
es esto?" for nouns. Further, the MLA guide did not provide, in 
either the lesson exercises or in the index, English equivalents for 
Spanish vocabulary. Consequently each teacher presented his own 
version. Since several acceptable variants were possible, students 
may have had difficulty providing the correct Spanish response for 
an English expression not used in their class. For example, the 
word "iCuidado*" on the test is elicited by "Watch out!"; yet, many 
teachers may have related "iCuidado!" to "Be careful!" in their 
classes. 

(2) In the SPA course, oral Spanish responses were frequently xinder the 
control of English stim\ili. Since all English stimuli in the SPA 
vocabulary test were taken directly from the course, there was no 
problem with acceptable variants. 

(3) Pictures could have been used as stimuli in many cases (especially 
for concrete nouns), but there were several limitations. For exam- 
ple, a picture of a horse might have elicited the responses "animal" 
or "horse." A picture of a cowboy might have elicited the responses 
"cowboy," "rancher," "man," "sheriff," etc. Time did not permit a 
thorough investigation of the use of pictures in the speaking tests. 



3» Speaking Expression Test (UAE). 

In this test, the student's control of Spanish expressions was evaluated. 
The concern was not with either disc 7 .ete vocabulary oi grammaticad elements, 
but rather with the use of expressions to convey meaning. Consequently, differ- 
ent expressions were tested which sometimes represented the same grammatical 
patterns. Grammatical errors were ignored as long as the meaning of the utter- 
ance was not changed or made ambiguous. T Pronunciation errors were ignored as 
long as the utterance was comprehensible to a native speaker of Spanish. 

The test was divided into two parts to reflect the fact that the students 
were expected to control the expressions under different conditions. In Part 
I the student was presented with an English stimulus and asked to respond 
orally with the Spanish utterance that meant approximately the scune thing. 

All items began with the English instruction, "How would you say in 
Spanish?" For example, the student heard the following from the tape recorder: 
"How would you say in Spanish: "What day is today?" The student wets expected 

to respond in Spanish: "iQuS diA es hoy?" The English stimulus was repeated 

twice. All student responses represented expressions taken directly from the 
course. 

In Part II , the student response was under the control of English instruc- 
tions and a Spanish stimulus as follows: 

• The student was first told in English what he would hear in Spanish 
and what his I'esponse in Spanish should be. These instructions were 
repeated twice . 

• The student then heard the Spanish stimulus twice. 

• After hearing the Spanish stimulus the second time, the student then 
made his response. 

In both Parts I and II student responses were tape-recorded for later 
evaluation by Judges. The tests were administered to students individually. 

1*. Speaking Prcjnunciation Tests (MLA, SPA, UAE). 

These tests were designed to measure the quality of the student's pronun- 
ciation, i.e., how closely the student could approximate the Spanish pronun- 
ciation of those elements of phonology emphasized in the language course. 

Since pronunciation may vary as a function of the context in which it 
occurs, it was decided to test the same linguistic features in three contexts: 
mimicry, constructed response, and oral reading. In the first case, the 
student merely imitated a Spanish stimulus (MLA, SPA, UAE). In the second 
case, the student constructed a response to a Spanish stimulus (MLA, SPA, UAE). 
In the third case, the student read adoud a written passage in Spanish (SPA). 
Reading aloud was riot possible for MLA and UAE since the students had not been 



Scoring procedures are described in detail on p. U 3 . 
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introduced to written Spanish as a course objective. In all cases, to make 
the scoring more objective and the final scores more useful, each item measur- 
ed only one aspect of Spanish phonology. This included discrete consonant and 
vowel sounds, diphthongs, intonation, rythm and word linking. 

One of the main problems in testing pronunciation in a context more near- 
ly approximating normal conversation was how to control the student response 
in order to be certain of eliciting the Spanish word, or words, which contain- 
ed the features to be evaluated. This problem was handled in the constructed 
response part of the pronunciation test by using the procedure of the speaking 
grammar test and by reducing the difficulty of items to increase the probabil- 
ity of eliciting the desired response. The student’s Spanish response was under 
the control of English instructions and a Spanish stimulus. The student was 
told in English what he would hear in Spanish and what his Spanish response 
should be. He then heard a simple Spanish stimulus which contained the word, 
or words, he would need for his response. For exan^le, in the following item 
the multiple flap rr in perro was tested. The student heard: 

"The teacher will say: What does Paco have? A dog?" 

"You say: Yes, Paco has a dog." 

"£Qu§ tiene Paco? Un perro?" 

The student heard the English instructions twice and then the Spanish 
stimulus twice before making his response in Spanish. Expected student resp- 
onses were: Si, Paco tiene un perro; Si, tiene xm perro; SI, un perro. 

Much effort was expended to simplify the items without redxicing them to 
straight mimicry. Nevertheless, during the pretesting of items some students 
still did not give the desired response or failed to respond at all. 

Reading and Writing Tests (SPA) . 

1. Reading Tests. 

The three reading tests (grammar, grammar transfer, and vocabulaiy) were 
almost exact parallels to the SPA listening comprehension tests. The main 
difference was as follows: In listening comprehension, the student listened 

to oral Spanish stimuli on a tape recorder. In the reading tests the student 
read the Spanish stimuli in the test booklet. In both cases, the Identical 
vocabuleuiy and grammatical elements were tested in the context of the same 
Spanish utterance. The sequence of the items was changed for the reading tests, 
and distractors were modified slightly in some items in order to eliminate 
visual clues when the student had the written Spanish stimulus before him. 

2. Writing tests. 

The writing tests (grammar, grammar transfer, and vocabulary) were almost 
exact parallels to the SPA speaking tests. The main differences were as 
follows : In the speaking test , the student listened to the Spanish stimulus 

and responded orally . In the writing test , the student read the stimulus in 
the test booklet and wrote his answer. In both cases , the content of the 
stimulus and response was identical, but the sequence of the items was changed 
for the writing tests. The vocabulary test was also used as a spelling test 
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(i.e., it was scored twice, once for correct vocabulary and once for 
spelling) • 

Specific Linguistic Content of Tests 

Early in the development of the tests it became clear that, with the necessity 
of developing tests for three different language courses (a total of 2o tests;, i 
would not be possible to develop equally exhaustive tests within the time limits 
of the project. It was decided to compromise mainly in the areas of pronunciation 
and morphology--pronunciation, because it was the most difficult language ^pec 
for which to obtain objective and reliable measures; morphology, because the 
number of different morphological characteristics, within each word class, was 
too large to permit the preparation of that many test items within the existing 
time constraints. 

To test morphology, selection was made from the word classes and morphological 
characteristics (e.g., number, gender, tense, person, agreement, etc.) emphasized 
in the language course. As for pronunciation, the main features of phonology 
emphasized in the language course were tested. 

In regard to syntax, one example of every pattern in the course was tested. 
Where the course contained more than one example of a pattern, the one most 
frequently used was generally tested. 

As for vocabulary, every word which the course developers expected the students 
to be able to control at the end of the instructional period was tested with the 
following exceptions. Comprehension of spoken numbers was limited to numbers 1 
through 19, in addition to one example from each subsequent decile (e.g., 25 » 33» 

Uj, etc.). 

Generally, only one form of a verb was tested — the one most commonly used in 
the course. (In listening comprehension, when verbs were tested as vocabulary, 
incorrect response choices never included other forms of the verb being tested. 
Other verbs used as response distractors were always the same person, number and 
tense of the verb being tested. ) 

Listening Comprehension Pretest 

A 60-item listening comprehension test was developed for administration to 
all students participating in the study prior to the start of instruction. The 
test was to be used as a basis for eliminating from the final data analysis those 
students with prior knowledge of Spanish. The items were prepared from a random 
selection of the content of the three language courses. There were 30 vocabulary 
items, 15 with picture responses and 15 with English alternatives, and 30 grammar 
items using English alternatives. The items followed the same style and format 
as those used in the final listening comprehension vocabulary and grammar tests 
which were described previously. The listening comprehension pretest reliability 
was .9U8 (using Kuder-Richardson formula 20). 

Student Attitude Questionnaire 

A questionnaire was developed to test the student’s interest in learning 
Spanish and confidence in his ability to learn the language. It was administered 
before instruction began and again after two semesters of Spanish had been 
completed. The pre instruct ion measures were used as independent variables in the 
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analysis, and the postinstruction measures were used as dependent variables. The 
questionnaire consisted of fifteen forced choice items— five on interest, five on 
confidence, and five neutral fillers. The student read a statement about learning 
Spanish and marked it true or false. Interest and confidence scores were calcula- 
ted and reported separately. Scores ranged from zero to five. The zero score in- 
dicated no interest or confidence and the five score indicated maximum interest or 
confidence. 



Test Construction Procedures 

The development of the tests was a cooperative effort involving the close 
teamwork of the course authors, test item writers, Spanish teachers, a Spanish 
linguist, and a foreign language testing specialist, under the direction of SDC*s 
Education and Training Staff. 

The following is an outline of the steps taken in the development of the tests 

1. Specification of coxirse objectives 

2. Content analysis of each course 

3. Training of test item writers 

U. Initial item-writing and editing 

a. Initial draft by item writers 

b. Review by test project director 

c. Revision by item writer 

d. Joint review of items for each course by all item writers and 
test project director 

e. Preparation of master revision 

5. Review by authors 

6. Review by testing and linguistic consultants 

T. Final revisions and preparation of first experimental version 
8. Item pretesting 

a. Tryout on three groups (native speakers, students who had not 
studied Spanish, students who had at least one year of Spanish 
instruction) . 

b. Item analyses 

c. Final revisions based on results of tryouts 



Course Objectives 

The first step was to meet with each course author to obtain a more specific 
description of course objectives. The objectives were discussed in terms of: (l) 

what the student was to be able to do, upon completion of instruction, with the 
linguistic elements contained in the course; (2) what level of performance would 
be considered satisfactory; (3) under what conditions satisfactory performance was 
to be achieved; and ( 4 ) how satisfactory performance would be recognized. At this 
stage the interest was not in identifying the specific linguistic elements to be 
tested, but rather in determining the stimulus conditions and response conditions 
necessary to make a vaJid testing situation. The course authors also used the 
occasion to provide information on ways in which the course content and teaching 
procedures needed to be updated. The definitive list of specific linguistic object 
ives was established later through a content analysis of each course. 

Content Analysis 




Prior to the writing of test items, a detailed content analysis of the three 
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courses was made by the Spanish teachers who served as consultants. This analy- 
sis identified, classified, and listed the specific vocabulary, grammatical pat- 
terns, and phonology included in each course. The system used to classify gram- 
matical patterns was set up by the linguistic consultant to the project. A unit- 
by-unit analysis was completed, with all new language elements entered in a cum- 
ulative inventory. The results of the analysis were periodically reviewed by the 
linguistic consultant. 

Training of Item Writers 

The consultants who did the content analyses also served as the test item 
writers. For the most part, their prior experience in test construction consist- 
ed of preparing tests for the high school Spanish classes they taught. A two- 
week training workshop was held which included the following acti'/ities; 

1. Critical examination of most of the currently used foreign language 
tests in light of principles of testing and of the particular purposes 
to be served by the tests we planned to develop. 

2. Practice in writing test items, followed by joint critique and revision 
of the items. This practice was repeated throughout the training per- 
iod. 

Initial Item Writing and Editing 

After the training period, one consultant was assigned to write the test 
items for one of the courses of study. The writing and editing proceeded as 
follows ; 

1. Initial draft by the it«n writer. 

2. Review and comments by the test project director. 

3. Revision by the item writer. 

k. Joint critique by all the item writers and the test project director of 
test items developed for each course of study. (In this way, each item 
writer was involved in developing test items for all three courses . ) 

5. Preparation of master revision. 

Review By Course Authors 

At this point the course authors were asked to; 

l. Indicate whether any item should be deleted because the linguistic ele- 
ment being tested was not part of the course objectives. (All courses 
were part of a continuing sequence of instruction. Except for SPA, more 
words and patterns were used in the courses than the students were 
expected to master at the end of the first year of instruction.) 

2. List any linguistic elements which were not included in the test, but 
which were part of the course objectives and therefore should be tested. 
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3. Indicate any defective items— test items which did not test what they 
were supposed to, and suggest any changes in stimulus or response con- 
ditions to maKe the items valid. 

Review By Linguistic and Test Consultants 

The test consultant checked primarily for defective items. The linguistic 
consultant checked for agreement of the Spanish utterance being tested and the 
listed grammatical classification. He also provided an additional check on Spanish 
authenticity and correctness. Some stimiili, containing artificial Spanish phrases, 
were retained if the phrases appeared in the language course in that manner. 

Final Revisions and Preparation of First Experimental Version 

Prior to pretesting the first e3<i)erimental version of the listening compre- 
hension vocabulary test, all pictures were first tested with sixth-grade pupils 
using English stimuli to ensure that the pictures conveyed their intended meanings. 
Many of the original pictures had to be revised, and close contact with the artist 
was necessary to achieve simplicity and clarity in the pictures. 

The speaking items were first pretested entirely in English with sixth-grade 
students (i.e., the student was told in English what the teacher would say and 
what his English response was to be. After hearing the stimulus from the teacher, 
the student responded in English.) Further pretesting, involving English and 
Spanish, was conducted with sixth graders who were bilingual and others who had 
at least one year of Spanish instruction. Items were tried with English instruc- 
tions presented once, followed by the Spanish stimulus once. A variation of this 
sequence was tried in which the student listened to the English and Spanish once 
and then heard it a second time, responding in Spanish to the Spanish stimulus. 
Another format tried was English instructions twice, followed by the Spanish stim- 
ulus twice, with the student responding in Spanish after the second presentation 
of the Spanish stimulus. 

As a result of this pretesting, it was decided to use a direct discourse for- 
mat (e.g. , your teacher will say, you say) and also to present the English instruc- 
tions twice, followed by the Spanish stimulus twice. 

Two sets of practice items immediately preceded the tests to ensure that the 
student xmderstood the tasks involved. The first set was completely in English: 

"Your teacher will say: Is Paco nice?” 

"You say: No. Paco is not nice.” 

”Is Paco nice?” 

Expected student response: No. Pano is not nice. 

The second set of practice items paralleled the actual test items further— 
both the stimulus and the student response were in Spanish. If the student made 
a mistake on the practice item because of confusion about the task, he received 
coaching from the test administrator. 

Final revisions were made for all tests and an experimental version was pre- 
pared for each one. 
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Item Pretesting and Item Analyse! 

1. Tryout of Eacperinental Verelon. 

Each teit vas tried out on three different groups of sixth-grade stud- 
ents— native speakers of Spanish, students who knew no Spanish, and students 
who had studied Spanish for at least one year. The average niaaber of sub- 
jects in each group, for each test, was approximately 30. 

a. Native speakers. 

The subjects were sixth-grade Mexican-Aaerican children from the Los 
Angeles School District, who were fluent in both English and Spanish. It 
was assumed that these students would make a perfect score on the test, 
\inless extraneous factors caused errors (e.g. , poor pictxires, aaibiguous 
choices, oanclear dii^etions, more than one possible acceptable response, 
poor tape z*ecording for auditory stimulus, etc.). Items missed by sever- 
al students were closely examined and were revised if found to be defect- 
ive. 

b. Non Spanish students. 

Ihe subjects were sixth-grade students who had never studied Spanish. 
Since these students were expected to make chance scores, all items on 
which the group did better than chance were examined closely for extrane- 
ous factors (e.g., specific determiners) wich might facilitate a correct 
answer even though the requisite knowledge was lacking. The pretesting 
of speaking and writing items with the "non Spanish" group was discontin- 
ued after a few subjects, as these students could hardly make any respon- 
ses. 

c. One-year Spanish students. 

The subjects were sixth-grade students who had studied Spanish in 
elementary school for one or more years. Only in the case of UAE were 
students available who had taken the course of instruction for which the 
test was being developed. High-low analysis (which identified all items 
in which low scoring students did better than high scoring students) was 
conducted to identify itenm needing further examination for possible ex- 
traneous factors. These data were also used to obtain preliminary inter- 
nal consistency estimates of reliability. 

2. Item Analyses. 

The item analyses based on the results of the pretesting with the above 
three groups were conducted mainly to identify items needing closer inspect- 
ion for the presence of extraneous factors; they were not conducted for the 
purpose of manipulating the difficulty level and discrimination power of 
items in order to obtain a wide distribution of test scores. 

No items were eliminated because of low discriminating powers, i.e., 
because all students got an item correct or all missed the item. The aim of 
the test was not to arbitrarily maximize discriminations among students who 
all had had the same language course, but rather to discriminate between two 
groups — one which had not studied Spanish and another which had. 
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Scoring the listening con(prehensicm and reading tests presented no prohlems 
since aultiple-choice items were used which could he scored ohjectively. 

Achieving objectivity in scoring the speaking and writing tests was a major 
challenge. The aim was to develop a system which would reduce subjective judg- 
ments on the part of scorers to a minimum9 essentially changing the role of the 
judge from decision-maker to rule- follower. The procedures developed to accomp- 
lish this are described below. 



Speaking Grammar and Speaking Grammar Transfer Tests (MLA, SPA) 

The use of written transcriptions of the tape-recoi^ed student responses con- 
tributed to increased objectivity of scoring. The scoring proceeded in two stages. 
The judges first listened to each tape and then wrote down exactly what the stud- 
ent said for each item. After transcriptions had been prepared for each student , 
the judges scored the tests from the transcriptions rather than from the tapes. 

^Is had several advantages. When scoring directly from the tapes 9 the judge had 
to listen to a response, stop the tape and then look at the scoring guide. While 
looking at the scoring guide, he had to depend on his memory to recall the ex^t 
student response. This system sometimes necessitated playing the tape several 
times. With a written transcription, the judge always had the st\ad«it response 
in front of him. Equally important is the fact that the judge could score all stud- 
ents on each item before going on to the next item, rather than score all items for 
cme student at a time. 

Each student response was scored twice. Each evaluation was based on a differ- 
ent criterion. The first scoring was on discrete grammatical elements, in which 
only errors on the point being tested caused a loss of credit. The seccsid scoring 
was on the entire utterance, which had to be completely error-free for the response 
to be marked correct. The total score for each evaluation was calculated and re- 
ported separately. The first scoring was considered to relate to basic course 
objectives, while the second reflected maximum objectives. 

1 . Scoring on Discrete Grammatical Elements. 

Each item in the test wan concerned with one discrete aspect of Spanish 
grammar. Errors in vocabulary, or grammatical mistakes unrelated to the point 
being tested, were ignored. Pronunciation errors also were ignored. Each 
item was scored on a right or wrong basis. No partial credit was given. 

The judge *s scoring guide listed the response (or responses) for each 
item which was acceptable as a correct answer. Each word in the acceptable 
response was given a slot number. Each slot contained an indication of what 
was necessary in that position to receive credit for a correct response. In 
the example which follows two acceptable responses are shown for purposes of 
illustration: 



Sample Item 

. Pattern being tested; Noun phrase as subject + verb "to be" + noun phrase 

as predicate nominative. 



• Student heard; "Your teacher will say; Is a cat a person or an animal?" 
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"You say: A cat is an animal. " 

"ils un gato una persona o un anlnmilT" 

• Scoring procedures 

a. Acceptable Resp<mse No. 1 (where noun phrase as subject was omitted) 

12 3 

Es + (ND) + animal (perscaia) 

b. Acceptable Response No. 2 (where noun phrase sis subject wsub present) 

1 2 3 U 5 

(ND) + gato + es + (ND) + noun predicate nom- 
inative, except 
gato or proper name 

Explanation of Acceptable Response No. 1 

(1) Slot 1. 

(2) Slot 2. 



(3) Slot 3. 



2. Scoring on Entire Utterance. 

The student response had to be perfect (except for pronunciation errors) 
when scored on the entire utterance in order to receive credit for a correct 
answer. Not only could there be no errors in vocabulary or grammar, but the 
factual content of the response had to be correct (e.g. , "Un gato es una per- 
sona" would be incorrect). A few minor substitutions or omissions of words 
were permitted in some items; these were indicated in the Judge’s scoring guide. 
Items were scored as either right or wrong. There was no partial credit. 

Thus, the final score represented the total number of perfect responses made 
by the student. 



Es must be present. 

The parentheses indicate that the element for that slot 
is optional. ND is the abbreviation for noun determin- 
er; noun determiner in parentheses (ND) means that the 
noun determiner may be omitted. Therefore, the student 
would not be penalised for omission of the article "un." 
("Es animal" woiild be scored as a correct response.) 
Furthermore, since the slot calls for a noun determiner, 
any noun determiner would be acceptable. However, if 
the student uses anything but a noun determiner in slot 
2, he is incorrect. 

If the word "un" had appeared in parentheses, instead of 
the category "noun determiner," it would have meant that 
"un" could be omitted but that "un" was the only noun 
determiner acceptable in that slot. 

A word (or group of words) in parentheses, immediately 
following another word, and not connected by a "plus" 
sign (in this case persona is in parentheses and follows 
animal) , may be substituted for the word it follows . In 
other words, either animal or persona would satisfy the 
requirements for this slot. 
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Pronunciation T»ati (MLA. 8PA. UAE) . 

The evaluation of pronunciation offered the most resistance to objectivity 
in scoring. To make the judge's task as specific as possible » each item focused 
on one discrete aspect of Spanish phonology. A three point scale was used to 
judge the student's response; however, it was described to the judges more as a 
forced choice. The judge's guide listed the Spanish feature being tested in one 
column (followed by a description of it) and the probable error in another column, 
(e.g. , feature tested— rr; discription— a multiple flap; English probable error- 
growled* r as in parrot). If the judge heard a close approximation of the feat- 
ure tested, he scored the item right (+). If he heard the probable error or a 
close approximation of it, he scored the item wrong (— ). If he heard something 
that was neither the featiire tested nor the probable error (or if he could not 
decide if it was either one) he scored the item as being in doubt (T). A score 
of ? assumed that the student response, in which the feature being tested 
appeared, was recognizable; otherwise, it was scored as no response (NR). The 
judges scores (i.e., +,?,-, NR) were translated into the following 3 point scale: 

+ = 2 (good) 

? ■ 1 (acceptable) 

NR, - ■ 0 (Inadequate) 

The judges were told only that they were to score on a right or wrong basis , 
or to indicate that they were not sure. They were not told of the point values 
assigned to their scoring. 

It was possible that some of the it^s scored represented errors other 
than the probable error; however, in most cases where the judge could not make a 
clear distinction between the feature being tested and the probable error, the 
so\md was probably somewhere between the Spanish and English pronunciation. 

Poor recording conditions sometimes resulted in extraneous noises on student 
response tapes, making the scoring of these tapes more difficult. Judges also 
repo 2 ?ted that in tiying to focus on a discrete phonological feature they were fre- 
quently distracted by other errors in the utterance. 

Speaking Vocabulary Teats (MIA. SPA) 



In each item the student was evaluated on one word (occasionally on an entire 
expression such as "Buenos dlas"). If the judge, listening to the tape, recognized 
the word, the item was marked as correct regardless of poor pronunciation or of 
errors in other parts of the utterance. Each item was scored as either right or 
wrong. Morphological errors were ignored (e.g., in testing for the word "tall," 

El padre es alta" would be scored as correct); credit was not lost for omission 
or incorrect use of articles with nouns. Since the scoring procedure was fairly 

simple and direct, the judges were able to score the vocab\ilary test directly from 
the tape. 

Speaking Expression Tests (UAE) 

In this test the student's use of Spanish expressions was evaluated. Control 
of discrete vocabulary and grammatical elements was not tested. Many of the ex- 
pressions tested represented the same grammatical pattern. 
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Each test item was scored twice. The first scoring was concerned with a min- 
imal acceptable response » which did not have to be error- free for the student to 
receive credit. The second scoring was on the entire utterance and required a 
perfect response to receive credit. 

1. Scoring on Minimal Acceptable Response. 

The emphasis was on whether or not the basic meaning of the utterance was 
communicated to a native speaker of Spanish. The Judge’s scoring guide indi- 
cated the key words which had to be present in the response for the item to 
be scored as correct. Each word in the expected response was given a slot 
number. Symbols were used to indicate what was necessary in each slot in ord- 
er to receive credit for a correct response (e.g. , a word in parentheses indi- 
cated that the word could be omitted, but if the slot was filled, it had to 
be filled with the word in the parentheses or from the class of words indica- 
ted in the parentheses). Grammatical errors which did not change the meaning 
of the utterance or make it Euoblguous were Ignored. Certain minor omissions 
and substitutions were permissible without loss of credit. Pronunciation 

errors had no effect on the scoring as long as the utterance was comprehens- 
ible. 

2. Scoring on Entire Utterance. 

The same items were scored again. However, except for pronunciation 
errors, the student response had to be completely error-free in order to re- 
ceive credit for a correct response. 

Writing Tests (SPA) 

1. Grammar and Grammar Transfer. 

The same scoring guide and procedures used for the speaking grammar and 
grammar transfer tests were followed. However, in the speaking tests, errors 
in pronunciation were ignored, while in the writing tests spelling mistakes 
did not cause items to be scored as incorrect. 

2. Vocabulary. 

Spelling mistakes were ignored unless the response was unrecognizable, 
just as pronunciation errors in the speaking test did not cause items to be 
scored as incorrect; otherwise the procedures were the same as in the speak- 
ing test. 

3. Spelling. 

The vocabulary test was scored a second time for spelling only. Items 
were scored right (+), wrong (-) or no response (NR). If the student did 
not respond, or his response was not the vocabulary word called for in the 
test item, the item was not scored for spelling but was marked "NR” instead. 

Training of Judges and Interjudge Agreement 

1. Training of Judges for Speaking Tests. 

a. Procedures. 
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Thrte Spanish teachers (all native speakers of the languafs*^) were 

used to evaluate each speaking test. Training of the Judges was conduct- 
ed to ensure conion Interpretation and use of the Judge's scoring guides. 

The following training procedures were followed for each test: 

(1) The Judges read copies of the "General Instructions" and the "Judge's 
Scoring Guide." 

(2) Suggestions and discussion resulted in a revision of the above docu- 
ments . 

(3) Using the revised instructions and guide, each Judge independently 
evaluated a few sample tapes and noted any problems or difficulties 
which arose during the scoring. 

(U) A group discussion resulted in further revision of the instructions 
and scoring guide. 

(^) The Judges met as a group to score a selected subsan^le of tests 

Jointly. One item at a time was scored secretly by each Judge; then 
the scores assigned were con^ared and discussed. For each item on 
which there was not perfect agreement, each Judge explained his scor- 
ing. The basis for the correct score for each item was thorouj^ly 
explained by the test project director. 

(6) The process of Joint scoring and discussion was repeated, using 

additional sample tapes, until the Judges were agreeing most of the 
time. 

b. Remarks on trednlng of Judges. 

(1) For the grammar and grammar transfer tests. Judges' errors during the 
training exercises were due principally to their changing the criter- 
ion, l.e., accepting a student error not permitted by the rules. It 
was made clear to the Judges that the rules were inflexible and had 
to be followed regardless of the Judge's agreement or disagreement 
with whether or not an error was serious enough to cause the item to 
be marked wrong. Subsequently, there was little difficulty. 

(2) The system of assigning slot numbers to every word in the response 
and indicating the requirements necessary for each slot made the 
scoring highly objective. 

(3) Subjective Judgment was reduced to a minimum except for the pronunci- 
ation test. This test offered the most difficulty. In evaluating 
sample tapes it became clear that although the Judges understood and 
were in agreement as to what they were listening for, their perceptions 
of the sounds differed. Background noise on some student response 
tapes also added to the difficulty of scoring these tests. Training 
of the Judges for the pronunciation tests required the most time, and 
the inter Judge agreement and individual Judge consistency were the 
lowest of the speaking tests. 

Inter Judge Agreement and Intrajudge Consistency. 

Following the training period, the tests in each speaking category (e.g.. 
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divided randomly among three Judges for scor- 

w3 ;;‘s;sf .2.SS1.- sr is- 

to indeoendenti V a ^ ^ category was completed, the Judges were asked 

see whether ^ °f 1° te«ts to 

Of the otoS t«; iSLr »d th. correlated with those of each 

as the measure of^nlerj’u^e correlations was used 

having e\c™ries“ore1i:;e%:s^ 

c^P^ation Of a correlation he^::^ Se^^^lJInri^tl IZ^^Yo'r 

and in"^raI:dgnoX^1;^^^^^ agreement 

nent and intrajudge consistency for each ?est 1 eLf L^a^f c"^L^ 

an^ M?A average interjudge correlations were high. For the SPA 

fal\feas-.i:-im 

»ent relief coLi1tenrovef?Lf® Snntraf ’‘Sree- 
one was .79 while the remaining 29 were .9U or higher. v^aiues, 

tests’^ra^Snc'’?^™ tests was lowest of all 

practice. J““Ses appeared to use more uniform standards as a result of 

s:.‘s3“sf3r“f ■-'s* “sr- 
ssr.r„s'r,"sjrs Fs 

Others Tha ln+>.«< a Judges was lower on this test than on the 

-is”« » .ss-t.'s^s “ “"■• "*“ 

^ ps^“Ka sc.s;.“"of!='X"t 's“ s* 5K “ 

Statist ical Characteristics of the Tests 

It SPA and UAE language courses are presented in Tables i ^ 

+u* respectively. Preliminary estimates of reliabilitv wpt*#» «>>+ • 

the final experimental tiyout of the tests with non-project subjects; hOTeyerf'°" 
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since the tests were revised again after the final experimental tryout, these re- 
liability data were not applicable to the finatl version of the tests. The relia- 
bility data reported in this section were computed from those subjects who partic- 
ipated in the study and received the final exams at the end of the school year, 
using Kuder-Richardson Formula 20. 

In considering Tables 13, lU, and 15, a wide range of test reliabilities is 
found. Two factors contribute to this variability. They are the length of a test 
and the degree of subjectivity in scoring procedures. As is always true, the long- 
er teats have the highest reliability; none of the lengthy vocabulary test relia- 
bilities is less than .9^. Among all tests in these tables, lowest reliabilities 
were obtained for the various pronunciation tests, which were scored most subject- 
ively. Thus, the pronunciation test reliabilities of less than .70 are a function 
of both the shortness of the tests and the inherent subjectivity of scoring. In 
general, the reliabilities for the listening con^rehension tests e«*e high. They 
vary from .836 to «987» with 9 of 12 values exceeding .91* The reading and writ- 
ing test reliabilities all exceed .87. 
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TABLE 5 

AVERAGE INTERJUDGE AGREEMENT IN SCORING MLA SPEAKING TESTS* 



Test 


First 

Scoring 


Second 

Scoring 


Grammar 






Entire utterance 


98/ 


97 


Discrete elements.... 


96 


96 


Grammar transfer 






Entire utterance 


9^ 


91 


Discrete elements.... 


91 


96 


Vocabulary 


99 


99 


Pronunc iat ion 






Mimicry 


76 


90 


Constructed response. 


66 


9h 



*Three judges independently scored a ccanmon sample of 10 
tests at the beginning of their scoring (first scoring), and 
scored another common sample of 10 tests at the conclusion of 
their scoring (second scoring). Each judge's first scoring was 
correlated with those of the other two judges; the average of the 
three correlations is reported in this table. 

/Decimal points have been omitted. Reliability coefficients 
have been ccurried to the nearest hundredth. 
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TABLE 6 



INTRAJUDGE 



CONSISTENCY 



IN SCORING MLA SPEAKING TESTS* 



Test 


Judge 1 


Judge 2 


Judge 3 


Grammar 








Entire utterance 


99/ 


99 


98 


Discrete elements 


79 


98 


99 


Grammar Transfer 








Entire utterance 


99 


99 


99 


Discrete elements 


95 


99 ; 


96 


Vocabulary 


99 


99 


99 


Pronunciation 








Mimicry 


98 


93 


91 


Constructed response ...... 


98 


98 


87 



*After all tests had been scored, each Judge rescored 5 tests which he 
had evaluated earlier; the correlation between the two scores is reported 
in this table. 

/Decimal points have been omitted. Reliability coefficients have been 
carried to the nearest hundredth. 
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TABLl 7 

AVIBAGE INTIRJUDGE AGREEMENT IN SCORING SPA SPEAKING TESTS* 



Test 


First 

Scoring 


Second 

Scoring 


Grammar 






Entire utterance 


98?^ 


99 


Discrete elements.... 


99 


97 


Grammar Transfer 






Entire utterance 


99 


96 


Discrete elements.... 


99 


95 


Vocabulary 


99 


99 


Mimicry 


72 


78 


Constructed response. 


70 


97 


Oral reading 


67 


8U 



*Three Judges independently scored a common sample of 10 
tests at the beginning of their scoring (first scoring), and scored 
another common sample of 10 tests at the conclusion of their 
scoring (second scoring). Each Judge's first scoring was correlated 
with those of the other two Judges; the average of the three cor- 
relations is reported in this table. 

/Decimal points have been omitted. Reliability coefficients 
have been carried to the nearest hundredth. 
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TABLl 8 



INTRAJUDGE CONSISTENCY IN SCORING SPA SPEAKING TESTS* 



Test 


Judge 1 


Judge 2 


Judge 3 


Grammar 








Entire utterance 


99/ 


99 


99 


Discrete elements 


99 


98 


99 


Grammar Transfer 








Entire utterance. 


99 


97 


98 


Discrete elonents 


99 


9k 


99 


Vocabulary 


99 


98 


99 


Pronunciation 








Mimicry 


96 


83 


98 


Constructed response 


9k 


8U 


98 


Oral reading 


98 


87 


9k 



*After all tests had been scored, each Judge rescored 5 tests which he 
had evaluated earlier; the correlation between the two scores is reported in 
this table. 

/Decimal points have been omitted. Reliability coefficients have been 
carried to the nearest hundredth. 




TABLE 9 



AVERAGE INTERJUDGE AGREEMENT IN SCORING SPA WRITING TESTS* 



Test 


First 

Scoring 


Second 

Scoring 


Grammar 






Entire utterance 


99/ 


99 


Discrete elements,,,. 


99 


99 


Grammar Transfer 






Entire utterance 


99 


9k 


Discrete delements,,. 


99 


75 


Vocabulary 


99 


99 


Spelling 


99 


99 



*Three Judges independently scored a common sample of 10 tests 
at the beginning of their scoring (first scoring), and scored anot- 
her common sample of 10 tests at the conclusion of their scoring 
(second scoring). Each Judge's first scoring vas correlated vith 
those of the other two Judges; the average of the three correlations 
is reported in this table, 

/Decimal points have been omitted. Reliability coefficients 
have been carried to the nearest hundredth. 
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TABLE 10 



INTRAJUDGE CONSISTENCY IN SCORING SPA WRITING TESTS** 



Test 


Judge 1 


Judge 2 


Judge 3 


Grammar 








Entire utterjuice 


99t^ 


oo 


97 




yy 


Discrete elements 


99 


98 


99 




Grammar Transfer 








Entire utterance 


99 


77 


99 




1 1 


Discrete elements 


99 


9U 


70 




Vocabulary 


QQ 


QQ 


99 




yy 


yy 


Spelling 


QQ 


qIi 


99 




yy 





u j *After all tests had been scored, each Judge rescored 5 tests which he 

had evaluated earlier; the correlation between the two scores is reported in 
this table. 



/Decimal points have been omitted. Reliability coefficients have been 
carried to the nearest hundredth. 
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TABLE 11 

AVERAGE IHTERJUDGE AGREEMENT IN SCORING UAE SPEAKING TESTS* 




*Tteee Judges independently scored a craomon sample of 10 

their scoring (first scoring), and 
scored another common sample of 10 tests at the conclusion of 
their scoring (second scoring). Each Judge's first scoring was 
correlated with those of the other two Judges; the average of 
the three correlations is reported in this table. 

/Decimal points have been omitted. Reliability coefficients 
have been carried to the nearest hundredth. 
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TABLE 12 

INTRAJUDGE CONSISTENCY IN SCORING UAE SPEAKING TESTS* 



Test 



Judge 1 



Judge 2 



Judge 3 



Expression (Pt, I) 



English stimulus 
Entire utterance 




7 ^ 



97 



English stimulus 
Minimal response. 

Expression (Pt, II) 



98 



69 



96 



Spanish stimulus 
Entire utterance 



98 



88 



99 



Spanish stimulus 
Minimal response 



99 



98 



99 



Pronunciation 
Mimicry. . . . 




78 



92 



Constructed response 



97 



93 



98 



*After all tests had been scored, each Judge rescored 5 tests which he 
had evaluated earlier; the correlation between the two scores is reported 
in this table. 

/Decimal points have been omitted. Reliability coefficients have been 
carried to the nearest hundredth. 



STATISTICAL CHARACTERISTICS OF MLA TESTS 
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spelling test represents another scoring of the writing vocabulary test. 



TABLE lU continued 
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TABLE ih continued 
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* Declinal points for reliability coefficients have been omitted. Each coefficient is presented to the 

nearest hundredth. 

7 All these are final tests. 

X No times are listed for speaking expression tests based on entire utterance. These represent another 
scoring of the expression tests (discrete elements), rather than separate instruments. 
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PART II 

RESULTS AND CONCLUSIONS 



In Chapters 5 * 6, and T» each of the three language courses is discussed in 
^n, one course to each chapter, and no comparisons are made between courses, 
is important to emphasize once again that although all three cours'^s were eval- 
uated as part of the same project, they actually represent three separate studies. 

_ is project measu r es the extent to which each c • >urse achieved its own objectives 
fflder sj)ecifled con d itions > and not whether one course was superior to another . 

The reader is cautioned against the temptation of comparing the courses on the 
as s of mean scores (as percentages of the maximum possible score) on the various 
tests. Such comparisons would be meaningless since the objectives of these 
courses differed both quantitatively and qualitatively, and the content and total 
number of items on each test were, therefore, different for each course. 

The following remarks about format and content apply to all three courses. 

The treatment of the data is divided into two parts, results aud discussion. Fol- 
lowing a verbal description of the results aind the discussion are tables with des- 
criptive statistics on all tests. The first tables at the end of each chapter 
U.e., MLA, Tables l 6 and IT; SPA, Tables kk, U5, and U 6 ; and UAE, Tables 89 and 
90 J summarize the results of all tests. For each test the following information 
is provided; the nuznber of students , maxlmuni possible score, mean score, and mean 
as a percentage of the maximum possible score, and the standard deviation. 

The listing of a test in this table does not always indicate that a separate 
-tast instrument was used. For example, scores for the entire utterance and dis- 
crete elements in grammar actually represent two different scorings of the same 
test. The same is true for grammar transfer. Also, scores on the midterm tests 
were compared with scores on the same tests given as part of the final examina- 
tion. The midterm tests and the midterm (as part of the final) are discussed 
only in relation to each other. 

The remaining tables in these chapters (MLA, Tables I8 - U3; SPA, Tables U7 - 
88; UAE, Tables 91 - llO) provide frequency distributions for individual tests* 
intercorrelations among all testa; correlations between independent and depen-* 
dent variables, including multiple regression analyses; and a rank ordering of 
classes in MLA and UAE in terms of mean achievement in listening comprehension 
vocabulary, showing relationships to class means on student, teacher, classroom, 
and district variables respectively. Tables showing the percentage of students re- 
sponding correctly to each item in each test are presented in Appendices A,B, and C, 

The discussion section contains further interpretation of the data, conclu- 
sions, and limitations to interpretation of results. Although the three language 
courses were analyzed separately, there were numerous cases where similar results 
led to similar language in the discussions. 



Chapter 8 is concerned with cost factors in the implementation of each of 
the t^ee courses of instruction. The cost of equipment and materials, in-service 
training, maintenance, and the man-hours spent by various personnel and offices 
within the school system are discussed for each course. 



Chapter 9 presents a summary and recommendations to school districts 
course developers and publishers respectively. 



and to 
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CHAPTER V 



RESULTS AND CONCLUSIONS 
FOR MLA 



Summary of All Tests 

Upon completion of the course, eight final tests were given, three in 
listening comprehension, and five in speaking. Tables l6 and IT present the over- 
all results. The number of students taking the listening tests ranged from 389 
to kok. With one exception, 55 students took each of the speaking tests. These 
55 students, selected randomly from among those taking the listening tests, did 
not differ appreciably from the students taking the listening tests, but not 
the speaking tests, in IQ, reading grade placement, amoimt of previous Spanish 
training, score on the Spanish pretest, and prelnstructlonal Interest and confi- 
dence . 

Achievement, in terms of mean scores as a percentage of the maximum possible 
score, ranged from a high of 71 percent in listening comprehension vocabiilary 
to a low of 5 percent in speaking grammar transfer (scoring on entire utterance). 
The overall achievement on all tests was low. The students did considerably bet- 
ter in listening conqprehension than In speaking. 

About half the tests showed a wide distribution of scores. On the other half 
of the tests, there was little variability, with most scores falling at the low 
end of the scale. 



Listening Comprehension 

The level of achievement on the final listening comprehension tests, shown 
in Tables 18, 19, and 20 was generally low. The highest achievement was in 
listening comprehension vocabulary, where the mean score was 71 percent of the 
maximum possible score. There was a considerable spread of scores. Approximate- 
ly one-third of the students reached the 8l percent mastery level or better, as 
shown in Table l8. About U6 percent of the students scored between 6l and 80 
percent, whereas 21 percent of the students were below the 6l percent level of 
achievement . 

Achievement on the listening comprehension grammar test was lower than on 
the listening comprehension vocabulary test. The mean was 6l percent of the max- 
imum possible score. A considerable dispersion of scores was again evident 
(Table 19). Only 7 percent of the students reached the 80 percent mastery level, 
whereas U3 percent of the students were below the 6l percent level. 

The lowest achievement was on the listening comprehension grammar transfer 
test, where the mean score was ii8 percent of the maximum possible score. Again, 
there was a fairly wide distribution of scores, as shown in Table 20. Less than 
2 percent of the students achieved the 8l percent mastery level, and 22 percent 
of the students scored between 6l and 80 percent. About one-fourth of the group 
made scores at about the chance level (i.e., 33 percent). 

Performance on the midterm listening comprehension vocabulary and grammar 
tests (vocab\ilary and grammar learned through Unit 7 of the course) was not sig- 
nificantly different from the results achieved when this part of the test was 
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given again as part of the finsuL examination. What was learned during the first 
half of the course was retained as new material was Introduced, but learning of 
first half material did not increase significantly during the last half of the 
course. The correlation between scores on the midterm and on this same test given 
at the end of instruction was .81 in vocabulary and .68 in grammar. Frequency dis- 
tributions of scores on the midterm vocabulary and grammar tests for both the mid- 
term performance and the final performance sure shown in Tables 21 through 2k, 

Speaking 

Achievement on the speaking tests was extroaely poor and far below the listen- 
ing comprehension resxxlts. The seven mean values varied from 5 to 51 percent of 
the maximum possible score, as shown in Table 17. 

The mean for speaking vocabulary was 28 percent, suid only 9 percent of the 
students achieved 51 percent or better, none exceeding the TO percent level. The 
four grammar and grammar transfer test means were all under 17 percent. There 
was little variability in performance on these tests, as can be seen in Tables 26 
through 29, showing frequency distributions of scores. Further, results were 
lower when scoring was on the entire utterance than when based on discrete elements. 

In pronunciation, mean performance on mimicry (51 percent) was better than on 
constructed response (35 percent). The constructed response scores, however, were 
depressed because the students did not respond to some items and, therefore, could 
receive no credit for pronunciation. Frequency distributions of scores on pronun- 
ciation tests are presented in Tables 30 and 31. 

Interest and Confidence 

There were no significant differences between mean measures of pre- and 
post instruct ion interest or pre- and post instruct ion confidence. The correlations 
between the pre- and post instruct ion scores were low (.3U for confidence and .21 
for interest). 



Class Achievement 



Tables 32, 33, and 3^ show selected student, teacher, and classroom charac- 
teristics respectively in relation to a rank ordering of class mean scores on the 
final listening comprehension vocabulary test. This test was chosen for this pre- 
sentation because achievement was higher than on any other test, and provided a 
relatively wide dispersion of scores. Independent variables were chosen for this 
presentation on the basis of having some degree of variability among classes. 

There was considerable variation in class achievement. However, none of the 
independent variables measured showed a relationship to this variation, as can be 
seen in the two tables. For example. Table 32 shows that of the six classes with 
the highest achievement, two had high mean IQs (ranking first and third out of 
l8), and two had much lower IQs (ranking 12th and 17th). The class with the second 
highest mean IQ ranked lUth in achievement. 

Teacher variables in relation to class achievaoaent are shown in Table 33. It 
can be seen, for example, that the class with the highest mean achlevonent in listen- 
ing comprehension vocabulary and one other of the top six classes had teachers with 
no prior experience in teaching Spanish, whereas one of the two classes which had 
teachers with five or more years of experience was 15th out of l8 in achievement. 
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Regarding the teacher’s use of English in the classroom, shown^^in Table 3^* 
the teacher of the top ranked class in achievement used it **rarely , and the 
teacher of the second ranked class ’’sometimes” used it. Of the bottom three 
classes, the teacher of the l8th used English ’’sometimes; the teacher of the 
17th used it ’*rarely;” and the teacher of the l6th used it ’frequently. 

Correlation and Regression Analyses 

Tables 35 - kO present the correlations of student, teacher, and classroom 
and district characteristics with performances on the listening comprehension and 
speaking tests. These data indicate that, for predictive purposes, none of the 
independent variables had a sufficiently strong and consistent relationship with 
the various test scores to merit much attention. 

It was expected that correlations would be relatively low because of the lack 
of control over classroom environment in the study. It is of some interest that 
a few variables showed consistent, if small, relationships to test scores. For 
example, it can be seen in both Tables 35 and 36 that IQ, grade point average for 
fifth grade work, and reading grade placement all had approximately the same degree 
of correlation with achievement across tests. Such results are suggestive of 
relationships bearing further investigation, particularly the interactions among 
variables that seem to have some influence upon achievement in the absence of 
rigorous environmental or statistical controls. 

In order to determine the extent to which different combinations of indepen- 
dent variables would relate to achievement, five multiple regression analyses were 
performed on the data. A computer program was used which takes the intercor- 
relations among variables and computes the regression of multiple independent var- 
iables on a given dependent variable. The results of the five regression analyses 
are given in Tables Ul and H2. 



The first regression analysis used five variables of student characteristics 
and all dependent variables; the second used five teacher variables; and the third 
used 11 variables of class characteristics. For the fourth analysis, six indepen- 
dent variables from all categories were isolated and their multiple regression on 
the dependent variables was determined.^ For the fifth analysis, the computer 
program was directed to take all independent variables Md select a ’’good subset 
in terms of the amount of variance in the dependent variable associated with the 
particular subset. 2 Seven variables were selected and their regressions with 
dependent variables were calculated. 



^ In each case, those variables were selected which the investigators felt 
would potentially relate most strongly to achievement. 

2 A ’’good" subset here was one of several, having high multiple regression 
coefficients, all of which were statistically equivalent. For a discussion of 
the criteria and methods used by the computer program to select a ’’good” subset, 
see L. Villone, R. McCornack, and K. Wood, Multiple Regression with Subsetting 
of Variables, System Development Corporation Document FN-6622/0/0, June 19o2. 








66 



These five regression analyses show that combinations of independent varia- 
bles were more highly related to student learning than were any of the individual 
variables. However, the analyses did not indicate that any one way of grouping 
variables was a better way of predicting student performance than was any other 
grouping. That is, student variables were not superior to teacher variables; 
variables selected mathematically by a computer were not superior to those se- 
lected by the investigators. The sizes of the multiple regression coefficients 
indicate that the independent variables measured in this study accounted for a 
relatively small percentage of the learning associated with the use of MLA materi 
als. 



Intercorrelations Among All Tests 



Table ^3 presents the correlations among all MLA tests. The intercorrela- 
tions among the three final listening comprehension tests were fairly high (.87, 
.77, .80). The intercorrelations among all speaking tests (except pronunciation) 
were also fairly high; four of the values were over .80 and only one of the re- 
maining six was under .73. The correlations involving the speaking pronunciation 
tests and all other tests were low, varying from .29 to .58. There were moderate 
positive correlations between the speaking vocabulary and grammar tests and the 
listening comprehension tests respectively, ranging from .U3 to .8U. 

Discussion 



The listening comprehension results were generally quite low. Only on the 
vocabulary test was the mean achievement reasonably high 71 percent of the maxi- 

mum possible score. However, even in this case the wide variability in performance 
presents serious problems of articulation (i.e., the ability of most students 
to profit from the instruction that would normally follow the first year’s course). 

The speaking results were extremely low (far below the listening comprehen- 
sion achievement), with almost all scores falling at the low end of the scale. 

The drop in scores from grammar to grammar transfer, in which the test item stimu- 
lus did not provide the student with all the words needed for his speaking respon- 
ses, may indicate that the students needed more practice in initiating utterances 
on their own, in contrast to responding to Spanish utterances. The sharp drop in 
speaking grammar and grammar transfer scores, when scoring was on the entire ut- 
terance (i.e., the student response had to be completely error-free to be marked 
correct) indicated that even in items where the discrete grammatical elements were 
correct, the students were making very few perfect responses. 

The poor performance in speaking raises questions concerning the relation- 
ship between listening comprehension and speaking. If it is true, as suggested 
by modern audio-lingual theory, that listening comprehension serves as an impor- 
tant foundation for developing skill in speaking, then the low achievement in 
speaking in this study may be explained in part by the students' incomplete con- 
trol in listening comprehension. 

However, even granting the relationship between these two skills suggested 
above, there is still the question as to the kind and amount of listening compre- 
hension training euid performance that should be provided. In other words, should 
a certain type and level of performance in listening comprehension first be 
achieved in order to obtain the most satisfactory progress in speaking? Should 
speaking practice be introduced more slowly, in smaller doses, increasing grad- 
ually as the students demonstrate a high level of performance in listening 
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comprehension? The relationship between listening comprehension and speaking 
skills should receive careful consideration in attempts to improve speaking 
instruction. 

As mentioned earlier, the overall results indicate that very few students are 
prepared for the next sequence of instruction. Even if the second year's course 
contained considerable review of first year material, individual differences make 
it unlikely that overall performance would improve significantly. It is more 
likely that variability in performance would increase from year to year. The 
schools would be faced with increasingly difficult problons of articulation, espe- 
cially as new skills such as reading and writing were introduced; many students 
would fall further and further behind in succeeding years. 

The results suggest that modifications to the materials might be needed to 
improve student performance. Appendix A contains student performance data (the 
percent of students responding correctly) for each specific vocabulary and gram- 
matical element. Those elements which very few or no students learned would 
require special attention. 

However, modification in the amount and type of practice for specific vocab- 
ulary and grammatical elements might not be sufficient. Given the lock-step sys- 
tem and a limited amount of time, it may be necessary to limit the total number 
of linguistic objectives to be taught in order to reduce the wide variability in 
end-of-course performance (i.e,, set up more feasible goals and thus provide more 
practice and greater variety with fewer vocabulary and grammaticsil elements). It 
is apparent that the typical end-of-course evaluation of students and assign- 
ment of grades ignores the problems implicit in the wide range in student perfor- 
mance . 

A possible explanation for the generally low student performance obtained in 
this study may be that the traditional method of preparing a whole semester's 
course (or a year's course) without pretesting as it is developed, and basing re- 
visions on subjective evaluations from teachers, is inadequate. If we wish to de- 
velop materials and procedures that are highly effective (i.e., that enable most 
students to achieve a specified minimal level of performance needed to proceed to 
the next sequence of instruction) with a given population of students, it is neces 
sary to pretest materials unit by unit on the intended students, basing revisions 
on a detailed, objective measurement of student performance. 

The following basic question must be answered, however, before valid conclu- 
sions can be drawn concerning the use of the MLA materials with sixth-grade stu- 
dents: To what extent are the results of this study a function of problems con- 

nected with lack of teacher experience in implementing a new instructional ap- 
proach and in using a set of materials for the first time? Are the results repre- 
sentative of what might be expected after the school and teachers had experience 
in using the materials? This study should be repeated in school districts having 
various amounts of experience in using these materials before drawing definite 
conclusions. 



Limitations in the Interpretation of Results 



The implications drawn from the results must be qualified by a number of 
factors. One of these is the size of the sample participating in the final test- 
ing (i.e., 389-UOU for the listening tests and only 55 for the speaking tests). 
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Lack of experience In using new materials and a new instructional approach, 
as mentioned above, is another consideration. Lack of lead time In getting the 
project under way meant that orientation sessions for teachers were necessaurily 
very brief. The field consultants held teacher orientation meetings prior to 
the beginning of instruction, but it was impossible to hold meetings between 
teachers and authors until several weeks after instruction had begun. Teachers 
began instruction in most cases with insufficient information concerning course 
objectives, materials, and procedures. 

MLA materials were not received by some classes until some time after the 
start of the semester. Until the materials arrived, teachers conducting these 
classes improvised Spanish instruction in a variety of ways, using a variety of 
materials . 

The use of tape recordings for presentation of the Spanish stimuli on the 
listening comprehension tests may have caused a problem for students who had 
only heard Spanish from a live teacher and from other students. Recording student 
oral responses during individual speaking tests may also have been a cause of 
apprehension and inhibition on the part of students. 

The MLA materials were originally designed for third graders. One of the 
course authors provided supplementary exercises for each unit to incorporate 
recent developments In applied linguistics and to adapt the materials to sixth 
graders. However, it is possible that this necessarily hasty modification of 
materials did not completely satisfy requirements for the sixth-grade group. 

Furthermore, the length of the tests, especially in vocabulary, may have 
caused students to tire during testing, thereby lowering scores somewhat. The 
use of English stimuli to elicit responses in Spanish on the speaking vocabulary 
test has already been discussed in the section describing the test instruments. 
There is also the general limitation inherent in this type of testing in that 
students are responding to isolated utterances, outside of the situational con- 
text found in both normal conversation and, to a large degree, in the instruc- 
tion. 
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TABLE 18 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
LISTENING COMPREHENSION VOCABULARY TEST 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 



9.0 



81 - 90 23.6 

71 - 80 26.5 

6l - 70 19,3 

51 - 60 12,6 



^ 1-50 5 , 1 , 

31 - ho 2.3 

21-30 1,3 

11-20 0 



0-10 



0 



100.0 
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TABLE 19 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
LISTENING COMPREHENSION GRAMMAR TEST 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 1.3 

8l - 90 6.1 

71 - 80 2U.8 

6l - 70. 2k.O 

31 - 60 20.3 

hi - 30 12.9 

31 - Uo 6.8 

21 - 30 2.0 

11 - 20 8 

0 - 10 8 



100.0 
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TABLE 20 



FREQUENCY DISTRIBUTION OP SCORES ON FINAL MLA 
LISTENING COMPREHENSION GRAMMAR TRANSFER TEST 



Percentage 
of Items 
Correct 

91 - 100., 

8l - 90... 

71 - 80 .., 

6l - 70... 
51 - 60 ... 
^1 - 50... 
31 - Uo... 
21 - 30... 
11 - 20 ... 
0 - 10 ... 



Percentage 

of 

Students 

0 

1.5 
8.9 

13.9 

2i*.5 

20.0 

20.6 

5.5 
2.7 
2.2 



100.0 




TABIil 21 



FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM MLA 
LISTENING COMPREHENSION VOCABULARY TEST 



Percentage Percentage 

of Items 

Correct Students 



91 - 100 15.0 

8l - 32.6 

71 - 80 23.5 

6l - 1^*2 

51 - 

kl - 2.5 

31 - ho 1*1 

21 - 30 5 

11 - 20 0 

0 - 10 0 

100.0 



100.0 







TABLl 22 



FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM MLA 
LISTENING COMPREHENSION VOCABULARY TEST 
(as part of final test) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



01 - 100 




ftn _ 00 




71 _ 8o 




_ 70 




*>i . 6o 




Ul _ so 




'll — Uo 


8 


pi « “30 


0 


11 — PO. a a • 1 


0 







100.0 
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TABLE 21+ 



FREQUENCY DISTRIBUTION OF SCORES ON 
LISTENING COMPREHENSION GRAMMAR 
(as part of final test) 

Percentage 
of Items 
Correct 

91 - 100 ■ 


MIDTERM MLA 
TEST 

Percentage 

of 

Students 


8l - 90 






71 - 80 






6l - 70,.... 






51 - 60 






1+1 - 50 






31 - 1+0 






21 - 30 






11 - 20 






0 - 10 







100.0 
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TABLE 25 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING VOCABULARY TEST 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 


0 


8l - 90 


0 


71 - 80 


. 0 


61-70 


. 3.7 


51 - 6o 


. 5.5 


hi - 50 


. T.h 


31 - Uo 


. 2h,l 


21 - 30 


• 31.5 


11 - 20 ,,,, 


. 18.5 


0 - 10 


. 9.3 



100.0 
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TABLE 26 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING GRAMMAR TEST 
(discrete elements) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 


100 






81 - 


90 






71 - 


80 






61 - 


70 






51 - 


60 






1*1 - 


50 






31 - 


UO 






21 - 


30 






11 - 


20 






0 - 


10 







100.0 
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TABLE 27 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING GRAMMAR TEST 
(entire utterance) 
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table 28 



FREQUENCY DISTRIBUTION OP SCORES ON FINAL MLA 
SPEAKING GRAMMAR TRANSFER TEST 
(discrete elements) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 







91 - 100, 



8l - 90. 



0 



71 - 80. 



6l - 70. 



51 - 60. 



kl 50. 



0 



31 - 1*0. 



7.3 



21 - 30 . 



7.3 



11 - 20 , 



31*. 5 



0 - 10 . 



50.9 



100.0 





TABLE 29 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING GRAMMAR TRANSFER TEST 
(entire utterance) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 



0 



81 - 90 



0 



71 - 80 0 

61-70 0 

31 - 60 0 

hi - 30 0 

31 - UO 0 

21 - 30 3.3 

11 - 20 12.7 



0-10 



81.8 



100.0 
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TABLE 30 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING PRONUNCIATION TEST 
(mimicry) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 


.. 0 


8l - 90 ,,, 


.. 5.0 


71 - 80 


8.3 


6l - TO ,,, 


.. 18.3 


51 - 6o 


11.7 


kl - 50 


. 25.0 


31 - i^O 


. 26.7 1 


21-30 , 


5.0 1 


11 - 20 


0 1 


0-10 ^ . 


0 1 

100.0 1 
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TABLE 31 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL MLA 
SPEAKING PRONUNCIATION TESTS 
(constructed response) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 0 

8l - 90 0 

71 - 80 3.3 

6l - 70 1.7 

^1 - 60 6.7 

hi - 30 20.0 

31 - UO 28.3 

21 - 30.. 23.3 

11 - 20 13.3 

0 - 10 3.3 



99.9 
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TABLE 32 



STUDENT CHARACTERISTICS IN MLA CLASSES, SHOWING THE DISTRIBUTION 
OF MEAN CHARACTERISTICS ACCORDING TO A RANKING OF CLASSES BY 
MEAN SCORE IN FINAL LISTENING COMPREHENSION VOCABULARY* 



Class 

Rank 

< 


Mean Score 
as Percentage 
of Maximum 
Possible Score 
in Listening 
Vocabulary 


Student Characteristics 


Mean 

IQ 


Mean 

Reading 

Grade 

Placement 


1 


83 . U 5 


122.22 


6.79 


2 


82.88 


117.1+6 


6.67 


3 


81 . 1+9 


105.25 


— 


k 


81.37 


100.80 


5.77 


5 


80 . 51 + 


111.06 


6.1+6 


6 


80.35 


III+.83 


6 . 81 + 


7 


76.66 


Ilk. 66 


5.71 


8 


73 . 61 + 


101.96 


5.35 


9 


71.78 


113 . 1+0 


6.01 


10 


71 . 1 + 1 + 


107.58 


5.97 


11 


65.37 


109.22 


6.17 


12 


61+.68 


108.1+7 


6.03 


13 


61.0I+ 


106.26 


6.08 


Ih 


60.28 


119.50 


6.06 


15 


58.22 


105.56 


6.0I+ 


l6 


57.77 


8I+.92 


1+.1+2 


17 


56.21 


102.1+1+ 


5.25 


18 


50.7U 


103.85 


I+.87 



^ V V ^ wwow ffcbo s^xiuaai x\J± 

this presentation because achievement on it was higher than on any 
other test and provided a relatively wide dispersion of scores. 
Independent variables were chosen for this presentation on the 
basis of having some degree of variability among classes. 
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TABLE 3*+ 

USE OF ENGLISH IN MLA CLASSES ACCORDING TO A RANKING 
OF CLASSES BY MEAN SCORE IN FINAL LISTENING COMPREHENSION VOCABULARY* 



Class 

Rank 



Mean Score As Percentage 
of Maximum Possible Score 
in Listening Vocabulary- 



Classroom Characteristics 



Student Use 
of English 
in Class 



Teacher Use 
of English 
in Class 



1 


83.1*5 


Rarely I 


Rarely 


2 


82.88 


Rarely 


Sometimes 


3 


81.1*9 


Sometimes 


Frequently 


k 


81.37 


Rarely 


Rarely 


5 


80.5*+ 


Sometimes 


Sometimes 


6 


80.35 


Rarely 


Rarely 


7 


76.66 


Rarely 


Rarely 


8 


73. 6U 


Rarely 


Rarely 


9 


71.78 


Rarely 


Rarely 


10 


71.*+*+ 


Sometimes 


Sometimes 


11 


65.37 


Sometimes 


Sometimes 


12 


6U.68 


Sometimes 


1 Sometimes 


13 


6l.0*+ 


Rarely 


Rarely 


lU 


60.28 


Rarely 


Rarely 


15 


58.22 


Rarely 


Rarely 


l6 


57.77 


Frequently 


Frequently 


17 


56.21 


Sometimes 


Rarely 


18 


50.7*+ 


Rarely 


Sometimes 



*The listening comprehension vocabulary test was chosen for this presen- 
tation because achievement on it was higher than on any other test, and it pro- 
vided a relatively wide dispersion of scores. Independent variables were chosen 
for this presentation on the basis of having some degree of variability among 
classes. 
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TABLE 35 

CORRELATION MATRIX SHOWING RELATIONSHIPS OF STUDENT CHARACTERISTICS 
TO LISTENING COMPREHENSION TEST PERFORMANCE IN MLA CLASSES 
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CORRELATION MATRIX SHOWING RELATIONSHIPS OF CLASSROOM AND DISTRICT CHARACTERISTICS 
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CHAPTER VI 






RESULTS AND CONCLUSIONS 
FOR SPA 



Summary of All Teats 

Upon completion of the course, sixteen final tests were administered to the 
students (three in listening comprehension; three in reading; six in speaking; 
and four in writing). Tables present overall results. 

Unfortunately, only about 10 percent of the total number of students who 
received the SPA course completed the program, imd only these students received 
the final examination. The number of students taking the final examination 
varied between UU— U9. This was due mainly to the fact that in many instances, 
instructional materials (tapes and programmed texts) and tape recorders were not 
received until some weeks or even months after the beginning of the school year. 
The students completing the program primarily came frcxn those schools that first 
received materials. However, many students in these same schools did not com- 
plete the program; thus, late receipt of materials was not the only explanation 
for the fact that many students were unable to reach the end of the program by 
the end of the school year. 

The small group who completed the SPA program, 5 ^ of approximately 6OO stu- 
dents, might have represented a biased subsample consisting of those students 
who were more highly motivated and/or had higher ability. However, queries di- 
rected to the teachers revealed that this group also Included students of low and 
average ability who raced through the program without working the exercises 
appropriately so that they could keep pace with friends or could be among the 
first to finish. 



It was foiind that the students completing the course were not appreciably 
different from the students who did not complete the course in IQ, reading grade 
placement, previous training in Spanish, score on the Spanish pretest, and pre- 
instructional interest and confidence. 



Achievement in terms of mean score as a percentage of the maximum possible 
score ranged from a high of 87 percent in listening comprehension vocabulary to 
a low of 12 percent in speaking grammar transfer scored on the basis of entire 
utterance. The achievement in listening ccmiprehenslon and reading was consider- 
ably higher than in speaking and writing. Of the four skills, the students did 
best in listening comprehension and poorest in speaking. 

Most of the tests resulted in a wide distribution of scores. However, on 
several of the speaking tests, most scores fell at the low end of the scale. Only 
the listening comprehension vocabulary test showed a skewed distribution, with most 
of the scores clustered at the high end of the scale. 

Listening Comprehension and Reading 

Tables U7-52 contain freq.uency distributions of scores on the listening com- 
prehension and reading tests. The highest achievement in SPA was in listening 
comprehension. In listening comprehension vocabulary, the mean score was 87 per- 
cent of the maximum possible score. Table indicates that there was not a wide 
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dispersion of scores. On this test, 56 percent of the students achieved higher 
than the 90 percent mastery level, and 75 percent of the students scored above 
the 80 percent level (Table U7). Only 8 percent of the atudents acored lower 

than the 70 percent level. 

Achievement on the listening comprehension graamar test (Table U8) was lower 
than on the listening comprehension vocabulary test, and there was also a wider 
distribution of scores. The mean was 72 percent of the maximum possible score, 
with only 6 percent of the students reaching the 90 percent mastery level; 3o per- 
cent of the students scored between 6l and 80 percent; and 27 percent of the stud- 
ents achieved below the 6l percent level. The listening comprehension gramar 
transfer results (Table U9) were comparable to the grammar test results, ^e 
reading vocabulary, grammar and grammar transfer test results, shown in Tables 5 
thro ugh 56, closely pare0.1el those of the listening comprehension tests. 

Performance on the midterm listening comprehension vocabulary Md grammar 
tests (vocabulary and grammar learned through Unit 30 of the course), was not sig- 
nificantly different from performance when the test was given again at the 
the course as part of the final examination. Apparently, what was learned during 
the first half of the course was retained as new material was introduced,, but 
learning of first half material did not increase significantly during the last 
half of the course. The correlation between scores on the midterm and on this 
same test given at the end of instruction was .77 in vocabulary’’ and .62 in gramar. 
Frequency distributions of scores on the midterm vocabulary and grammar tests for 
both the midterm performance and the final performance are shown in Tables 50 

through 53 • 



Sneaking and Writing 



Achievement in speaking and writing was much lower than in listening compre- 
hension and reading (see Tables 57-70). In speaking vocabulary, the mean was only 
55 percent of the maximum possible score. Table 57 indicates a considerable spread 
of scores for the speaking vocabulary test, showing 12 percent of the studen s 
scoring over the 80 percent level, 36 percent of the students scoring between 61 
and 80 percent, 23 percent between the Ul and 60 percent levels and 2o percent of 
the students scoring under UO percent. 



The means of the four speaking grammar and grammar transfer scores were even 
lower than in vocabulary. The four values varied from 12 to 27 percent of the 
n^a■v^Tml1n possible score. There was little variability, with most of the scores 
falling at the low end of the distribution. Results were lower when scoring was 
on the entire utterance than when based on discrete elanents. The writing voca 
ulaiy, grammar, and grammar transfer results shown in Tables 65 through 69 close- 
ly parallel those of the speaking tests. 



In pronunciation, performance on mimicry (mean of 7^ percent) was h 8 ®s , 
oral reading (mean of 60 percent) next, and constructed response (mean of 55 per- 
cent) lowest. The constructed response scores, however, were depressed became the 
students did not respond to some items and, therefore, could receive no credit for 
pronunciation. Spelling vocabulary scores were also somewhat depressed because 
students did not respond to some vocabulary items and, therefore, coul no rece ve 
credit for spelling. The frequency distribution of scores in spelling is shown n 

Table 70. 




Interegt and Confidence 
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There were no significant differences between students* mean pre- and post- 
instruction interest and pre- and postinstruction confidence. However, the 

correlations between pre- and postinstruction scores were low (,19 for interest, 
and ,23 for confidence). 



Correlation and Regression Analyses 

present the correlations of student, teacher, classroom, and 
district characteristics with performances on the various tests. These data 
indicate that, for predictive purposes, none of the independent variables had a 

su ciently strong and consistent relationship to student learning to merit much 
attention. 



These correlations were expected to be relatively low because of the lack of 
control over classroom environment in the study. The small number of students 

who completed the SPA course makes any extensive interpretation of these low 
correlations unrealistic. 



To determine the extent to which different combinations of independent 
variables were related to achievement using SPA materials, a con5>uter program was 
employed which takes a matrix of intercorrelations and computes the regression 
o multiple independent variables on given dependent variables. The results of 
five regression analyses are shown in Tables 80 thro ugh 82, 



For the five regression analyses, all dependent variables were used, and five 
sets of independent variables?! (l) five student variables; (2) five teacher vari- 
ables; (3) eight classroom variables; (i+) four variables selected by the computer 
prop*^ as a good subset in terms of the amount of variance in the dependent 
variable associated with the subset ;2 and (5) six variables from all categories. 



These regression analyses indicated that the combinations of independent 
variables were more highly related to student achievement than were any of the 
individual variables. There was some tendency for the eight classroom variables 
to show a higher relationship to learning than was the case vith teacher or studen 
variables, a surprising finding in light of the self-instructional features of the 
SPA ^erials. Again, the small number of students completing the SPA course must 
qualify apr interpretation of this finding, but it does suggest that classroom 
characteristics may play more of a role in student learning from self-inst ructions 
naterials than has been suspected. 



XU general, the sizes of the multiple regression coefficients indicated that 
the independent variables measured in this study accounted for a relatively small 
percentage of the learning associated with the use of SPA materials. 



o 

ERIC 



1 In each case, those variables were selected which the investigators felt 

would potentially relate most strongly to achievement, except when the selection 
was made by computer. 

«««ral. having hieJi multiple regression 

eoemeients, all of >*ieh were statistically equivalent. For a discussion of thi 
criteria md methods used by the con^uter program to select a good subset see L 

Wood. Multiple Regression with Subsetting of 
Variables, System Development Corporation Document 111-6623/0/0, June 1962 
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Intercorrelatlona Among All Teats 

Tables 83 throu^ 88 present the Intercorrelations among all SPA tests. The 
Intercorrelations among the final listening comprehension tests, the reading tests, 
and the writing tests respectively were generally high, most of them falling In 
the .80' 8 and .90*8. The Intercorrelatlona Involving the speaking vocabulary, 
grammar, and grammar transfer tests were also generally high, (mostly In the .90's), 
but correlations of speaking grammar transfer (discrete elements) and other speak- 
ing teats produced values varying from .5^ to .6U. 

The three pronunciation tests have the lowest correlations , both with each 
other (.U8, .57t and .70) and with all other tests. The correlations with other 
tests vary from .35 to .90, with most of the values under .60. The correlations 
between listening and reading tests were quite high; the same was true between 
speaking and writing. However, the correlations of listening or reading tests 
with either speaking or writing were much lower. 

Discussion 



The listening and reading comprehension vocabulary scores were the highest 
of all tests and were close to the kind of results frequently claimed, but seldom 
achieved, by programmed learning (l.e., most students mastering most of the mater- 
ial presented and differing only In the amount of time to complete the course). 

The mean achievement In listening comprehension vocabiilary was 87 percent, and In 
reading vocabulary, 85 percent, with a relatively small dispersion of scores. 

In general, the results of the listening and reading comprehension grammar 
and grammar transfer tests , though short of expectations for programmed Instruc- 
tion, yielded reasonably good student performance by conventional standards. 
However, performance on most of these tests was contrary to claims that programmed 
Instruction eliminates Individual variability In achievement. 

The speaking and writing results were considerably lower than those In listen- 
ing comprehension and reading, and far below expectations for programmed Instruc- 
tion. On the speaking vocabulary test, mean achievement was 55 percent, with only 
13 percent of the students scoring above the 80 percent level. In writing vocab- 
ulary, the mean was 60 percent, with 21 percent of the students' scores above the 
80 percent level. In speaking and writing grammar and grammar transfer, very few 
students scored above the 50 percent mastery level. 

The drop in scores from grammar to grammar transfer, where the student was 
not provided with a stimulus that Included all the words needed for his speaking 
and writing responses, may Indicate that the students need more practice in 
initiating utterances. In contrast to responding to Spanish stimuli. 

The sharp drop In speaking and writing grammar and grammar transfer scores, 
when scoring was on the entire utterance (l.e., student response had to be com- 
pletely error-free to be marked correct). Indicated that even where the discrete 
grammatical elements were correct, the students were making very few perfect re- 
sponses. 

Since speaking was the least well learned of the four skills, questions may 
be raised concerning contributing factors and possible solutions. For example, 
to what extent is the lack of objective feedback to the student on the correctness 
or Incorrectness of his oral responses a factor? Is the fact that the student 











lol* 



lemingT* ^ tape-recorded teacher an important constraint in language 

stude^%o°^^^^ discrimination training that was intended to enable the 

tiof Howe^r “°^itor and critically evaluate his own pronuncia- 

which th?r^Ii^w ? determine the eJrtent to 

contributed to between the sounds of Spanish and English 

to ^ow ho« fu 5 P®^fo«nance in pronunciation. Further, there is a need 

speech in repaid to® ^as able to monitor and critically evaluate his own 

morphology and syntax and what techniques can be developed 
to help him do so more effectively, ucvcxupea 



sessiM^- recomended teacher-conducted "conversational display 

rairw^ tn^^vf^rth” ? for students who were at the same place in the ^ogran. 
™tside the the students with an opportunity to use their new Spanish 

th. °5 program. There was no evidence in this study that 

effect on achievement. However, since noM of the 

abilitv to*fo*fl *'** program ahead of the students, their 

lity to conduct the display sessions effectively may have been limited. 

suggest that modifications to the materials may be needed to 

f ® the student ^rfor^l^crdrta 

mattp»?*«?^ Studen^ responding correctly) for each specific vocabulary and gram- 

thepr^gfa:^%T“;::i^^^^^^^ 

wo^d probably result in boredom and fatigue rather tha^ Jn J^rovem^f oTle^. 

The results indicate that very few students would be prepared for the next 
s^uence of instruction (Spanish B) in speaking and writing JLy wo^f h^f 

SPA la tn listening con^irehension and reading. As 

P°®®tble to repeat units for the purpose ^ addUio^ 
nniv 1 f+?°® particiaar skill. (Thus, a student who was having difficulty 

writing would have to repeat items in all four skills.) Ideallv It 
would seem that when a language program has the objective of teaching the four 

s“dLS*S ®P®«hi“8. reading, and writing) it sL^fS 

w^M there is 1 need training in any particular skill, 

where there is a need, without having to receive training in all skills. 

One could argue that the poor performance and the variation in ■ni»T-rn>nn«n«e» 
on m^y of the criterion variables shoidd have been eliminated through the ore 

developing programmed maSs! ^^^^^^ 
sible explanation of the results of this study may be a failure to carry out^ 
these procedures adequately, « x«j.xure no carry out 

However, SPA was not developed specifically for sixth-grade nunils It 
developed using elementary, secondary, and college studentsf^ It may be’that if 
th® com^nly accepted ideal of programmed learning (having 90 pL^t or more of 
the students master 90 percent or more of the material) if to be achieved the ^ 
materials must be designed for a more restricted population of students and must 
go through a more extensive pretest and revision evnie iis-ini» -i... must 

subject, frem the target group them ® 
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One explanation of the poor results in speaking can he found in reports by 
field consultants and teachers indicating that many students did not follow in- 
structions, e.g., did not make overt, oral responses as required by the program. 
With closer supervision and greater involvement on the part of the teachers in 
creating the proper learning environment, the results might have been different. 
This leads to a basic question which should be answered before valid conclusions 
can be drawn concerning the use of SPA with sixth-grade pupils: To what extent 

were the results of this, study a function of problems connected with the initial 
implementation of new materials and a new instructional approach (i.e., to what de- 
gree were the materials and equipment misused due to lack of teacher experience)? 

In other words, were the results representative of what might be expected after 
administrators and teachers had experience in using the materials? There is con- 
siderable evidence that the way materials are used may be as important as the 
materials themselves. In this study, field reports indicated that some students 
went through units rapidly, without making responses, in order to keep up with or 
ahead of friends. It would seem highly appropriate to repeat the present study 
in school districts that have various amounts of experience in using the materials 
before drawing definite conclusions about their use with sixth-grade students. 

inie present project also suggests that longitudinal studies should be con- 
ducted to answer Important questions about foreign language learning. For exam- 
ple, is there an optimum level of mastery that should be reached in one of the 
four basic skills before the student undertakes another? Can a hierarchy in level 
of difficiilty be established for vocabulary and grammatical elements through stu- 
dying the relationship between student performance data and amount of practice 
provided in each linguistic element within a given skill? If so, such an analysis 
could serve to validate predictions derived from contrastive analyses as to 
difficulties involved in certain specific aspects of foreign language learning. The 
results could be used in the modification of existing materials and in the design 
of new materials. Longitudinal studies could also be conducted to shed light on 
the length of time (i.e., hours of instruction) necessary for individuals of given 
characteristics to achieve a specified level of competence in foreign language 
skills. 



Limitations in the Interpretation of Results 

There are several limitations which should be mentioned in regard to this 
study. First, the in5)lications drawn from the data must be qualified by the size 
of the sainple (5^ students) that participated in all the final tests. 

Lack of experience in using new materials and a new instructionsl approach 
has been previously mentioned in the discussion section. Orientation sessions for 
teachers were very brief. The field consultants held teacher orientation meetings 
prior to the beginning of instruction, but it was not possible to hold meetings 
between teachers and authors until several weeks after the course had begun. Teach- 
ers began instruction in most cases with insufficient knowledge or practice in 
the handling of equipment. None of the teachers had an opportimity to take the 

program prior to the students. 

Field reports indicated that students also had problems in using materials. 

For exaa^le, a student would sometimes receive and use the wrong tape (e.g., use 
the tape for Unit 20 with Unit 19 in the programmed text). Occasionally a lesson 
might be taken out of sequence (e.g.. Unit 11 before Iftiit 10 ). Tape breakage and 
malfunction of recorders, foot pedals and headsets were a source of student and/or 
teacher frustration, irritation, and discouragement. 
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Some schools did not have one tape-recorder for each student. Therefore, 
students sometimes worked on their program with two or three other students, 
simultaneously listening to one tape-recorder rather than listening individu- 
ally as specified in the course instructions. 

The length of some tests (especially the vocabulary tests) may have 
caused fatigue in students, resulting in depressed scores. There was also a 
general limitation inherent in this type of testing in that students responded 
to isolated utterances, outside of the situational context found both in nor- 
mal conversation and, to a large degree, in the instruction. 
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*A11 final tests 




♦All final tests 
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TABLl kf 

FREQUMCY DISTRIBUTIOII OF SCOTO ON FINAL SPA 
USOTIIG COMPHIHINSION VOCABULAHY TEST 



Percentage 


Percentage 


of Items 


of 


Correct 


Students 


91 - 100 





8l - 90 19.6 



Yl - ou 

6l - 70 


U.3 


51 - 60 




Ul - SO 


2.2 


- Uo 


0 


21 - SO 


0 


11 - 20 


0 


0 - 10 





100.0 
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TABLE U8 



FREQUEHCY DISTRIBUTION OP SCORES ON PINAL SPA 
LISTENING COMPREHENSION GRAMMAR TEST 



Psrctntage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 


6.8 


81 - 90 


29.6 


71 - 80 


20. U 


61 - 70 


15.9 


51 - 60 




hi - ^0 


6.8 


31 - ho 




21 - 30 


0 


n - 20 


0 


1 

0 1 

1 

H 1 

0 i 





100.0 



TABLE h9 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
LISTENING COMPREHENSION GRAMMAR TRANSFER TEST 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 6.U 

8l - 90 25.3 

71 - 80 23. U 

6l - 70 10.6 

^1 - 60 21.3 

kl - ^0 10.6 

31 - ho 2.1 

21 - 30 0 

11 - 20 0 

0 - 10 0 



99.9 
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TABLE 50 

FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM SPA 
LISTENING COMPREHENSION VOCABULARY TEST 



Percentage 


Percentage 


of Items 


of 


Correct 


Students 


01 - 100 


5U.0 


8l - 00 


29,7 


71 - 80 


8,1 


61-70 





51 - 60 2.7 

kl - 50 0 

31 - UO 0 

21 - 30 0 

11-20 0 

' 0 - 10 0 



99.9 











TABLE 51 

FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM SPA 
LISTENING COMPREHENSION VOCABULARY TEST 
(as part of final test) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 




.... 67 . U 








.... 10.8 




.... 2.2 




.... 2.2 




.... 0 




.... 0 




.... 0 




..... 0 




0 



100,0 




TABLE 52 



FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM SPA 
LISTENING COMPREHENSION GRAMMAR TEST 






Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 
81 - 90 . 
71 - 80., 
6l - 70 ., 
51 - 60., 
Ul - 50.. 
31 - UO.. 
21 - 30 .. 
11 - 20 .. 
0 - 10 .. 



13.5 

10.8 

35.1 

18.9 

10.8 

5.U 



5.k 



0 

0 

0 

9 ^ 
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TABLE 53 



FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM SPA 
LISTENING COMPREHENSION GRAMMAR TEST 
(as part of final test) 



Percentage 
of Items 
Correct 

91 - 100 . 



81 - 35 .^ 

T1 - 80 

6l - 12.5 



Percentage 

of 

Students 



7 



51 - 6o 3.3 

Ul - 50 2.1 

31 - UO 3.3 

21 - 30 0 



11 - 20 
0-10 



100.0 
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TABLE 3k 



frequency distribution op scores 

READING VOCABULARY TEST 



ON FINAL SPA 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100, 



8l - 90, 



71 - 80, 



6l - 70, 



51 - 60, 



kl - 50, 



31 - 40, 



21 - 30, 



11 - 20 , 



0 - 10 , 






ERJC 



48.9 



23.4 



12.8 



8.5 



4.3 



2.1 



0 



100.0 
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TABLE 55 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
READING GRAMMAR TEST 



Percentage Percentage 

of Items 

Correct Students 



91 - 100 10 *^ 

8l - 

71 - 80 27.1 

6l - 

51 - l8*T 

kl - 10 *^ 



31 - ho 



6.3 



21 - 30 



0 



11 - 20 



0 



0-10 



100.0 
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FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
READING GRAMMAR TRANSFER TEST 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 6.3 

81 - 90 26.1 

71 - 80 17.^ 

61 - 70 1^.2 

31 - 60 17. U 

hi - ^0 6.3 

31 - 40 8.7 

21 - 30 2.2 

11 - 20 0 

0 - 10 0 



100.0 
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TABLE 5T 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING VOCABULARY TEST 

P«rcent»g« Percentage 

of Items 

Correct Students 

91 - 100 ^'3 



8l - 

71 - Q*5 

6l - 27.6 

51 - 12.8 

kl - 1°*^ 

31 - 12,8 



21 - 30 
11 - 20 



100,0 
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TABLE ^8 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING GRAMMAR TEST 
(discrete element) 

/ 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 0 

8l - 90 k.l 

71 - 80 0 

6l - 70 0 

51 - 60 0 

Ul - 50 10.2 

31 - ho 28.6 

21 - 30 2h.k 

11 - 20 2U.5 

0 - 10 10.2 

100.0 
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TABLE ?9 




FREQUENCY DISTRIBUTION OP SCORES ON 
SPEAKING GRAMMAR TEST 
(entire utterance) 



FINAL SPA 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 
8l - 90., 
71 - 80 ., 
6l - 70.. 
51 - 60 .. 
^1 - 50.. 
31 - 1*0.., 
21 - 30.., 
11 - 20 ... 
0 - 10 ... 



2.0 

2.0 

0 

0 

k.l 

10.2 

20 . 1 * 

30.6 

30.6 

99I9 
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TABLE 60 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING GRAMMAR TRANSFER TEST 
(discrete elements) 



Percentage 
of Items 
Correct 

91 - 100 


Percentage 

of 

Students 


8l - 90 




71 - 80 




6l - 70 


0 


51 - 60 




kl - 50 




31 - iiO 




21 - 30 




11 - 20 




0 - 10 





100.0 









TABLE 6l 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING GRAMMAR TRANSFER TEST 
(entire utterance) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 



0 



81 - 



90 



0 



71 - 80 
6l - 70 



51 “ 80 a ••••••••••••• a • a a a a ^ ^ ^ ^ 2al 

i*l - 50 0 



31 - 



ho 



6.h 



21 - 30 8.5 

11 - 20 29.8 

0 - 10 51.1 



100.0 
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TABLE 62 

I 



FREQUENCY DISTRIBUTION OP SCORES ON FINAL SPA 
SPEAKING PRONUNCIATION TEST 
(mimicry) 



Percentage 
of Items 
Correct 

91 - 100 . 
81 - 90.., 
71 - 80.., 
61 - 70.., 
51 - 60.., 
Ul - 50... 
31 - UO... 
21 - 30 ... 
11 - 20 ... 
0 - 10 ... 



Percentage 

of 

Students 

0 

36.7 

3U.7 

1U.3 

6.1 

k.l 

0 

2.0 

2.0 

0 

9979 
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TABLE 63 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING PRONUNCIATION TEST 
(oral reading) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100, 



81 - 90, 



9.2 



71 - 80 



61 - 



51 - 60, 



10.2 



Ul - 



31 - UO, 



12.2 



21 - 30, 



6.1 



11 - 20 , 



U.l 



0 - 10 , 



2.0 



100.0 
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TABLE 6k 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
SPEAKING PRONUNCIATION TEST 
(constructed response) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 




81 - 90 




71 - 80 




61-70 




51-60 




kl - 50 




31-1*0 




21 - 30 




11 - 20 




0-10 





100.0 
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TABLE 65 

FREQUENCY DISTRIBUTION OP SCORES ON FINAL SPA 
WRITING VOCABULARY TEST 



Percentage 
of Items 
Correct 

91 - 100 .. 

81 - 90.., 

71 - 80.., 



Percentage 

of 

Students 



8.5 



12.8 



21.3 



" 70 

51 - 60 19^1 

Ul - 50.... llj^9 

31 - 1*0 6 . 1 * 

21 - 30 6 . 1 * 

11 - 20 1*.2 

0-10 2.1 



100.0 
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TABLE 66 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
WRITING GRAMMAR TEST 
(discrete elements) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 2.1 

81 ~ 90 2.1 

71 - 80 2.1 

6l - 70 2.1 

51 - 6o 6.U 

hi - 50 12.8 

31 - Uo 17.0 

21 - 30 8.5 

11 - 20 23. U 

0 - 10 23. U 

99T9 
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TABLE 6T 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL SPA 
WRITING GRAMMAR TEST 
(entire response) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 



I 



2.1 



81 - 90 
71 - 80 
6l - 70, 



51 - 60 1,.3 

Ul -> 30... 3,^ 




31 - i»0 
21 - 30 
11 - 20 , 
0 - 10 , 



10.6 

17.0 

23.k 

29.8 
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TABLE 68 



FREQUENCY DISTRIBUTION OP SCORES ON FINAL SPA 
WRITING GRAMMAR TRANSFER TEST 
(discrete elements) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 2.1 

81 - 90 2.1 

T1 - 80 2.1 

61-70 1^.3 

51 - 60 5^5 

^1 - 50 ; 8.5 



31 — ^0.............,,,,,^,,,,,,,,,^^^^^^ li^3 

21 - 30 17,0 

11 - 20 21.3 

0 - 10 29.8 



100.0 
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TABLl 69 



FRlQUEHCy DISTRIBUnOH OF SCORES ON FINAL SPA 
NRITINO GRAMMAR TRANSFER TEST 
(entire response) 



Percentage Percentage 

of Items of 
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TABLE 70 



FREQUENCY DISTRIBUTION OP SCORES ON FINAL SPA 
WRITING SPELLING TEST 



Percentage 
of Items 
Correct 



91 - 100, 



8l - 90, 



71 - 80, 



6l - 70, 



51 - 6o, 



Ul - 50, 



31 - 40, 



21 - 30, 



11 - 20 , 



0 - 10 , 



Percentage 

of 

Students 



h.3 



6.U 



10.6 



lU.9 



10.6 



lU.9 



17.0 



8.5 



8.5 



U.3 



100.0 
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Correlations confuted frm code with 1 equal to male and 2 equal to female. 









■vvn;<; V(i.»^f<.^y*i.-if<., 






139 



VO 



m 

u 

•H 

+> 

CO 

•H 

u 

0) 

+> 

xi 

o 

o 

xi 

0^ 

o 

E^ 



+> 

m 

0) 

E^ 



#X9S 


COO\(nvO H 0^ CO lA-sl- 

CO-tf H CO CO -si- ^ -S1--S1- 

III! 1 1 1 II 


a9V 


H CO -sf O O -sf On -sf CO 

-si- -si- CO -si- -si- -si- -si- -si- -si- 


qoapoJd uf 
qsfiTBdg Sufuonaj, 
ux quaiii^opua 
uofqonjqsufqsod 


CO irv CO ON CO 00 O ITN-d- 

OJCOOOJ CM CO -si- COCO 


q.oapoj(i uf 
qsfireds Sufuouaji 
uf quautitopug 

uo'pqanjqsu'pajd 


CMC3NCOOO -si- 0 \ C- -STUN 

CO -si- H CM CM CO CO -si- -si- 


sjapajo q^xxg 
joj qsxuadg 
pjaaoi apnq-pqqv 
uofqonjqsufqsod 


VO-=l-C>-CM 00 CM O CJnoO 

CO IfN H CO CM -si- -4- -si- -si- 


sjapajf) qqxfg 
joj qsfuadg 
pjaAOi apnqfqqv 
uofqonjqsufajd 


CO COVO C3N -4- O C3N O O 

CM -si- O CM CM -si- CO -si- -si- 


qsfuadg 

Sujqaaaj^ aaua'pjadxg 


VO COVO ITN ITN 00 H -4- H 

HCMOCM CM CM CO CMCM 

1 1 1 1 1 1 1 II 


qsfiTBdg uf Sufuiiaji 


rH-4-rHC-” On t — CM COCM 

CMCMCMCO CO CO -4- CMCM 

1 1 1 1 1 1 1 II 


qs-ptredg ux Xouanxg 


CO-4- 00 VO H CM -4- C--S1- 

OHOH CM H CM OO 

1 II 1 1 1 




O 



Correlations computed from code with 1 equal to male and 2 equal to female. 



iko 



t- 

t- 



s 



O 



o o 

H H 







o 



District 
Chauract eri sties 


q.joddng aq.’Bq.g 

JO ©diCj, 


VO 00 b— 00 'sO ^ 

CO 00 CVl 00 00 00 00 

II II III 


iCc^jsuoci 

uoi^^axndod: 


CVl ON 00 .it ON O ITN 

H H O 00 H OO H 

1 II III 


azjS 


ra ir\ 00 H ON VO 

o cy ^ CM H 

II 1 1 III 


Classroom Characteristics 


suo^ssag iCaxdsjd 
JO asn 


07 

02 

11 

-17 

-11 

-27 

-28 


ssaio apjsq.no 

UT 8 j; 3 oj(i 
JO asn 


00-4; VO I-H r-j VO OO 

7 -r T ° 7 ° 7 


uojSTAjadng 

jaqoaai 


o o o o o o o 


HSjuadg 
Sujjncr ■^Q-TAjq.ov 
moojssaxO -isilQ-O 


vq ® o CM CM OO 

HO H H O H H 


sraxTd JO asn 
^ZBq.uamaxddng 


k2 

31 

28 

32 

29 

26 

31 


sameo pira 
sSuog JO asn 
jCjaq.uaiiiaxddng 


CM ON ON b- ON H irv 

CM H O 00 CM .Jt ^ 




sxansjA jo asn 
.^aq.uamaxddng 


CM On On t— ON H LTN 

CM H O 00 CM .^4 .^4 




ssaxo JO azjg 


k3 

31 

37 

39 

3k 

36 

30 


Test 


Midterm vocabulary 

Midterm vocabulary 

(as part of final test) 

Midterm grammar 

Midterm grammar 

(as part of final test) 

Final vocabulary 

Final grammar 

Final grammar transfer... 





iki 



00 

1^ 



i 




District 
Cheuract eris ti cs 


1 q^oddns aq-^Q-S 

JO dd^ 


sa HCMWIA 1 

ICpfOCVI CO ^POCMO 1 

I'll 1 till 1 


X!^-p8U9a 

uojq.«xn<Io<i 


V oiHCMo 1 


»ZTS 


1 «l <n Cjl « rj rf 1 


1 CO 

1 ^ 

1 *H 

1 09 

1 *H 

1 V 

1 ■** 

i) 

3 

1 Cf 1 


1 uojsssg Xsx<Istci 
JO 8sn 


fcr cMt-o\co 1 

T T ? 7 77 7 7 


88 VX 0 9pj8q.no 
waaSoj^ 
JO 98/1 


1 o Ji! « !0 2^2^ 'o cn 1 

7 t ° 7 77 7 7 


uoj8jAJ9dns 

J9q099£ 


looo o oooo I 


tf8ja«ds 
Sajano ^q.jAjq.ov 
1000^889X0 J911V) 


s 3 S ^ ^ ? 


§ 

1 CO 1 

3 

1 r« p 


8®TTd JO 9sn 
^8q.U9iii9xddns 


30 

32 

15 

19 

36 

02 

-01 

25 


1 ^ 1 


891DB0 pus I 

SSUOS JO 98/1 

.£j9q.U9i09xddns I 


?n 2 SR vs VO-4- lA CM I 

«*i-a-cM cn cncMH.^ I 




8X«n8JA JO 98/1 

.^J9q.U9iii9xddns I 


®9 Q OO VO VO «5f irv f\j 1 

1*^ <3 CM cn ^ w H ^ I 


1 


889X0 JO 9ZJS 1 


Sx -JtHlA’sO 1 

mjtcn In Hocn .Sf 1 


Test 


Speaking graaaar 

(entire utterance) 

Speaking 

(discrete elements) 

Speaking grammar 

transfer 

(entire utterance) 
Speakina grasmar. ...,«.•• 
transfer 

(discrete elements) 

Speaking vocabulary 

Pronunciation 

(constructed response) 

Pronunciation 

(mimicry) 

Pronunciation 

(oral reading) 



er|c 






1U2 









On 

t- 

a 



X 



K 



a 



n 

o 

•H 
•p 
•P CQ 
O *H 
•H fH 
fH fl) 
•p -p 
n o 
•H OS 

JC3 

o 



CO 

o 

•H 

•p 

CO 

•H 

0 ) 

•p 

& 

o 

§ 

o 

m 

CO 

OS 



q.Jodc[ng aq.'Bq.g 

JO 



^q.j 8 Ud(i 

uof^^BXndOti 



szTS 



SUOTSS0S 

JO SSfl 



SSBXO spisq.no 

lUBj 30 Jd 

JO 0 sn 



uoxsxAJ 0 dng 

J 0 qo 00 ji 



qsxiredg 
Suxjnci .^q.XAxq.ov 
inoojssBXO -isq^^O 



Br jU JO ssn 

itiB q.U 0 tii 0 xddng 



S0HTBO piTB 

s3uog JO 0sn 
iti 0 q.u 0 in 0 xddng 



sxsnsxA JO ssn 

iCj 0 q.u 0 ui 0 xddng 



8S0XO JO szTS 



•p 

fO 

0 ) 



-=t t- 
m cn cn cn 

II II 






ro 

I 



fH 

I 



op m ^ 

'l''V VT 1 * T 



CO oj 
<n CO 
-L ! 



VO cn 
cvj m 

_! I 



00 

00 

I 



oo 

oo 

I 



-^00 VO t— o 

HO 00 CVJ oo 

II II I 



CO 



oo oo ^ o 
H H O 

I I I 



-sf 

O 

I 



o o o o 



00-^ 
O H 



VO H CVJ 

HO O 

I 



CVJ 

o 

I 



CVJ t- 
00 -sj- 



ON H VO 

H CVJ H 



ON 

CVJ 



00 O 
OO -St 



-St b“ 
-St OO 



b- 

OO 



VO 

OO 



OO o 
OO-St 



-St b“ 
-St OO 



b- 

OO 



VO 

oo 



-St lA 
00 -St 



OO CO 
CVJ 00 



VO 

oo 



VO 

-St 



CO 

oo 

I 



CJn b- 

‘V'V 



On 

o 

I 



VO irv 
H H 
I I 



ON 

oo 

I 



ITN OO 

oo oo 

I I 



oo 

'V 



H -St 
O O 
I I 



b- lA OO 

? TT 



o o o 



o 

1* 



d 

o o 



CVJ 



o o 



VO 

cn 



CO o 
CVJ cn 



VO 

cn 



00 o 

CVJ <n 



00 



O CVJ 




8) & h 

o 

bO t )0 4 H 

a a d n 

^ ^ fd § 

as as as Ih 

0) 0) 4) -p 

« » PC 















O 

CO 



a 

9 




tl 

a 



•P 

n 

Cl 

i; 

la 



1 



tl 

o 

a 

•S 



Vi 

d 

o 

o 



g 



I 



•p 

«a 

d 



t> 

& 



II 

s 



iS 



(o 



•d 

•I • 

t) n 
u u 
o 

• -p 

&,& 
d *H 
h -p 






« . 

d 

*8 

0) 






i-p 
«£■ 



'8 
&>8 



•P 

or « 

H H 

- ® 

» « 



09 



d *H 



g 



-S 

p 

•p 



4S 

8^ 






o 

2? 
•P -P 
09 O 
d 0) 



0) t) 
h 09 
Pi 

_ t) 
'd h 



8 S 



•d 01 
a n 
•H 01 

S 0 

S' 



0 s 

K<S 

O 09 
d 09 
t) tl 
d 09 



Vl S 

0 



• • A| 

h 0 
0 >H 

x: *d 

go. 

0 o 

0 

.« n 

•p d 
0 
0 

h ** 

p e 



^ 8 



5 h 

0 

s s 

O 0 



•P O 

O 

Sf ••o 



u m 

-P >4 
tt C 7 



d « 

•H d 



^ I4 



& 



A 



or " 

H h 

fi 



2 

a 



01 


n n 
n p 


>8 




01 ^ 


d 


•H 


<0 d 




CO 


•H 


a 


"Kl 


^ s 




Pl-P 





•p ^ • 

d 0 0 



S •§ 

Si S) 



lk3 



01 

« 

d 



& 



*8 

0 



& 

w 

n 



I 

m 

tt 

d 



od 

n 



i&> 

“ 8 

d P< 



M 0 

•H "S 



8l 



P O 



P *d 
0 0 
ja -p 
o 

0 0 
0 H 
•P 0 
0 

*8 u 

S S 

0 

O 0 
0 0 
H 01 
Ag 

d 



I 



0 

p 



0) 0 
d 



'S 



^ -p 
0 O 

U Ti 

u 

.. "In 

d 

eg .. 

d 0 



*•3 



CO 



i 



m 

A 

•P *H 



d 

0 



Vl 

o 



I. 

L 



ERIC 



TABLE 80 ccMxtlnoed 



Ikk 



Independent Variables 


P««H b « 

fli) 


73 

70 

63 

88 

82 

81 


Jl 

1 ► 


0\ H ITN 00 

ifN «r\ lA m VC lA 


8X8 

}ll^ 


81 

79 

73 

85 
87 

86 


FiTe 

Teacher 

Variables' 


o\ VO oQ o <n m 

lA VO lA lA VO lA 


Fire 

Student 

Variables* 


b- lA VO H lA VO 

lA lA lA VO VO VO 


Test 


Listening vocabulary < . 

Listening graanar 

Listoiing gvmisr transfer. . 

Beading vocabulary 

Beading graanar 

Beading grwaawr transfer. . . . 



o 

ERIC 



TABLE 81 

MULTIPLE CORRELATION COEFFICIENTS (M SPA SPEAKING 









1 



li»5 





g n 
(0 

<g*s 



U) CO 





1U6 






o 

ERIC 



r'f tt .*■ .-*V 













CM 

CO 

i 

§ 



C 





si 

ll 



8 






s ^ 

Is 

V n 

S| 

tt 01 

is 

o 0 



u 

10 



ea 



m 0) 

•*”8 
10 4» 



6 



Oh .. 

O -P 

V >d 

3 9 
”S Tl 

la 

i<0H 

3 O 
oa 

« 

•* M • 

CO •H eo 

g u h 

H 

“ s a 

^ 8 -H 
O •H 4^ 
CO 10 



0 ) 

N 

•H 

CO 

■H 



S 3 
“5 
ft. 
§5 



I 

•P 

•H 

8 t 

» 

P< 

1 ^ 

A « 
oa ea 

*8* ^ 
d ea 



►» *H 
U 00 

d ea 
ti d 

5 " 
ft 

I! ^ 
h ea 

£ a 

SOH 
d o 

^ d 

tfS 

01 

h •• 
01 

•P _ 

58 

CO 

§ 8 
•H r4 
P O 
O 

2 *» 
CO 

P ^4 
CO 01 

a « 

•H i) 

s a 

•^15 



9 



or " 

M h 

e 

• • 

•p xi • 
d ea oa 

111 






•d <p 

H 

4> ^ 






1U8 












IU 9 



J9J8U8JJ; JBTtntlBJf) 

du-ppvoH 



m 

CO 



a 

a 



•P 

CO 

S 



-ar 

VO 



VO 

lA 



p\ CO g 






lA 

GO 



lA 

CO 



1 jumms JO 

1 


61 

68 

82 

88 

80 

79 


AiBinq'BOOA 


H t- -;t 0\ Q 


9uTp«dH 


00 VO o\ t“ o5 


jdjsuBjj^ jumorejo 


cvj fn CM <n 


3 ujuaq.spi 


t- VO 00 00 


jaianre JO 


ifv 00 t- 


3uf u©q.sn 


VO VO 00 


AroxnqnooA 


CVJ 


Sufuoqspi 


CO VO 


1 jumore JO 


VO 


iHJoqpf W 


t“ 


jCjBxnq'BOOA 




wjsqpiW 








•£ 

Vh 

(0 

§ 

+> 



I 

o 



■3 

•§ 



o 

g 



CO 

9 

+> 



& li 



■§ 

o 



e 

0 ) 






•H 

§ 

•8 

•H 



DO 

a 

•H 

a 

0 ) 

•p 

to 

•H 









& 



•rl 

a 

0 ) 

•s 



a 

(8 

K 



t£ 

a 



0 ) 

K 



^ er|c 



li 



*To simplify presentation, the decimal iK)int is not shown. Each coefficient is carried to 
the nearest hundredth. 



150 



s 



«p 

(0 

s 



(Sufpwsj xwjo) 
uo*p qB jounuo j<j 


O t- t- t- 00 t- 

00 o\ t- 00 VO -4- irv 


(iCjopajm) 


00 Q CM CM H O 


uo'pq.u'pounuojj 


irV'O lA lA t- t- 


(dsuodsdj paq.onaq.suoo) 


- 4 - 00 lA cn o 


uofq.'8Tounuoa<j 


-4- -4 on _4 t- 


(s^uauiaxa aq.aJ 0 spp) 




aajsueox aumuBao 


rH ^4 ^4 ^4 

VO VO lA VO 


3uj3p3adg 




(aoaejaq.q.n aJT^ua) 


CM m o\ 


jajsusaj^ jBimireJo 


o\ On go 


Sufifsadg 




(sq.udinaia aq.aaospp) 


H CM 


j'BuniiBjg 8u];xuadg 


o\ o\ 


(aoueaaq.q.n aJTq.ua) 


t- 


jBuiaieJo Sui^adg 


OV 


Aiuxi^q'BOOA 




SuT^sdg 






•H *H *H 

■S'8^ 

2 , 8 .^ 

CO CO 



CO 



‘S 

o 

•H 

o 

t 

0 ) 

o 

0 

1 

m 



i 

(Q 

•P 

O 

c 

CO 

•H 

"S 

•H 

O 

P 4 



Ct 

E 

•r 

O 

0 ) 

p 



s 

•H 

1 $ 

I 

CO 

P 4 



•H 

CO 

§ 



o 

ERIC 



carried to the nearest hundredth 









lA 

CO 



a 

i 



(s^uauaxa 9!).9josxP) 
jajsuBjj^ jnoimejo 

SutwM 


-4- C\J C\J lA CO 

OO 00 00 OO ON 


(aoirajaq.q.n ajxq.ua) 




jajsuajjj jaunnejo 


80 

79 

78 

83 


aujXT-iM 




(sq.uainaxa aq.ajosxP) 


^ ^ \o 


jaumrejo Suxq.XJA 


ON ON On 


(aoixejaq.q.n ajxq.ua) 


lA cn 


jenurejo 9ux^X*^M 


ON ON 


SuxXTQdg 


On 




ON 


jCJax’^'q.'BOOA 


, 







•P 

to 

0) 

EH 



& 



'3 



a 

S 



U) 

a 

•H 

H 

H 

0) 

P4 

0) 



0) 



( 1 ) 



bO 

a 

•H 

•P 

rs 



S’ 






L 



O 

ERIC 



151 



cn 



+> 

a 

0 ) 

•H 

O 



0 ) 

o 

o 



A 

u 

H 



I 

n 



a 



cn 



■§ 

•H 

O 

Pi 



■3 



o 

fS 



0 ) 

43 

P 



§ 

•H 

tj 

“S 

0 ) 

CO 

0 ) 

P4 



£* 



& 

.9 

CO 



I 



• v.v^«,«r 



carried to the nearest hundredth 



152 



'.I* n -r W/«I5 *■ 



MD 

CO 

g 

€ 



s 



9 



II (9u-fpaaj xsjo) 

II uo-pq.B'iiounuojj 


80 

78 

89 

86 

79 
86 
8 k 
79 


(iCjopn-fm) 

uofq.Bjounuoj£ 


H H lAj- ro t— lA 0 1 

MD- 4 - lA-ar lf\lAlAVO| 


1 (asuodsaj 

I p 0 q.OTixq.suoo ) 

II uo-fq.B-pounnoj(i 


VO t — t — ir\ CM GO On rH I 


1 (8q.U0ra0i0 0q.0josTP) 

II jsjstrajj, juamrejo 

II 9u-p^0ds 


0 0 - 4 - CO -d- CM ON GO 1 

VO lAVO-=f lA NO UN 1 


1 (90U8jaq.q.n 0 jq;q.U 0 ) 

jsjstnsjj; jBmar8j{) 

1 Sujsjuads 


62 

6 k 

68 

7 i» 

70 

62 

73 

68 


(sq.U0in0X0 oq.oJOSTp) 
jBumre j{) 9ui^0ds 


?Tr20Ot“CMCMt-H 
lAVO UNVOVO UNVOVOl 


1 ( 0 ouej 0 q.q.n 0 jxq.ua) 

JunnuB JO duj^ads 


VOVD t—t—t—VD 


iCJBxnqBOOA 

Suf^adg 


UN m 0 HVD On I 

VOVDVO t— t— VD t— VO 1 


Test 


Midterm vocabulary 

Midterm grammar 

Listening vocabulary 

Listening grammar 

Listening grannnar transfer. . . . 

Beading vocabulary 

Reading grammar 

Reading grammar transfer 



s 

» 



A 

9 > 



sinqolify presentation, the decimal point is not shovn. Each coefficient is carried to the nearest 









153 



GO 






t 

s 



(sq.U8U8X8 9q.dJOS|p) 
jejsuBJj; jummejo 

Sux^T-ia 


VOCOOJCVIC^HOO^- 
t-t- VO t- lA -is- -it oo 


(80izsj9q.:^n dJ-pc^ud) 
J9JSIX8JJ; juunrejo 


CUt-0\H 0-it0\0\ 

t-t- lA t— VO -4- -:t CO 


(Sq.U9lQ9I9 9q.9JOSXP) 
juumcsJO 9uxq.|Jfi 


HCVI-:l-CVIHOCVJt- 
ON C^ OO 0\ VO -it lA CX5 


(90ii8jaq.:pn ajxq.ua) 
jBmnrajO Su^q-TJA 


CVICVIt-<5\CVIVOt-H 

ON o\ CO CO lA cn oo 


auxxiadg 

aux^TJA 


H cn t— cn cn t— oo t— 

ov On oo ON VO -it ca oo 


XJBTT^quooA 

auxqx-iA 


mm t- CM H -jf VO lA ■ 

0\OS OO OV VO -it lA 00 




h u 

£ £ 

cn cn 

^ 

(0 h ^ h cn 

^ +» tt) +» ^ 

o fl 



1 ^ § 


g g 


i V i 


H B 


S *~4 B 


4) § 


S3 4) a 


■p a 



iH 

0) 



0) 

(0 

s 

p< 

CQ 

0) 

U 



fl tJ fl 
O 0) O 
H +9 *H 

y 43 



t)0 W O 
fl fl 
•H •H «H 

■StiS 

U 0) 0) 

|5| P«w 

CO CO 



gc Sg S’S 

•H O •H •H *H O 

M cn ^ -p (Q 
a ^ a fl « 

4 ) *0 4 ) 4 ) 4 ) *0 

S'' St'' St'' 






la 

•H h *H 

a 4^ a 

'll 

2w8 

£ £ 



O *H 
•H fd 

^ +a a 

g 

a a 

tn 

«|3 



»d 

0) 

•H 

§ 

o 

(0 



+> 

8 

•H 

o 

•H 

4h 

Vi 

4) 

O 

O 

xi 

8 

PO 



i 

■g 

t 

a 

(0 

•H 

•H 

a 

5 

O 

«§ 

■P 



8 

•H 

-p 

s 

CO 

ii 

Pi 



Pi 

W 

•H 

(Q 

§ 



o 



to the nearest hundredth. 



15U 



GO 

GO 



E3 

€ 



ii 



ERIC 



M » 

§ S 



CQ . 

< § 
H 
CO B 

- *-♦ 
^ K 

o :» 



s 



£ 
S “ 

CO p 

B8 

gB 

C5 O 
S5 H 

g« 

» 

CO 



X & 

S p 

is 



§S 



gi 



§ 



■p 

n 

0) 



(sq.UdU0X9 0q.0josip) 
j0j8Tzejj^ JBimnejf) 
9uT^^TJA 


65 

57 

79 

71 

73 

81 

82 

78 


(0OTZBj0q.q.n 0jjq.U0) 
j0jsuejx J'snzorejo 

SUZ%TAI\ 


67 

58 

83 

73 

75 

85 

83 

80 


(sq.U0Ui0X0 0q.0josxp) 
jsuimejf) 3uj%jjii\ 


H o\irNcvioo-;tvo c\i 

VO iTNvo t— VO VO r— t— 


( 00118 J0q.q.n 0axq.u0) 
J8uiui8ao Suiq-pj/ii 


m ifvoo o\-^vovo o\ 

ITNIAIAVOVO LPv t— VO 


9uxii0ds 


ITvCOCJVVOOVO Ht“ 

VO LPv VO t— C— VO CO t— 


XiBi:nq800A 

SuT^TJ!! 


62 

59 

66 

73 

70 

6h 

81 

76 






'S 



■3 

o 



o 



g 



*3 

•§ 



o 

s 



e 


e 


•a 


•H 

a 


•a 






0 ) 


0 ) 


0 ) 


0 ) 


0 ) 


'id 

(8 


•rl 


=8 




-p 

(0 




CO 


'S 




s 


•H 




•H 


.$2 

K 


£ 



nd 

Q> 



a 

o 



(Q 



0) 

•H 

O 



8 

U 



;a 



i 

,£3 

m 



"8 

a 



03 



3 

•H 

o 

p< 



1 

•r+ 

a 

•S 



0) 

.£3 

■P 



"S 

"S 
0) 
03 

£ 

P4 



g* 



•H 

03 



s 



to the nearest himdredth 



CHAPTER VII 



RESULTS AHD CONCLUSIONS 
FOR UAE 



SummEtry of All Tests 

Upon completion of the course, four final tests were given, one in listen- 
ing comprehension and three in various aspects of speaking. Tables 89 and 90 
summarize the results. At the end of the school year, 366 students took the 
final listening tests, and 56 students took the final speaking tests. This sub- 
sample of 56 students, selected randomly from among those taking the listening 
tests, did not differ appreciably from the nonselected students in terms of IQ, 
reading grade placanent, previous training in Spanish, score on the Spanish pre- 
test, and preinstruct ional interest and confidence. 

Mean achievement scores, given as a percentage of the maximum possible score, 
ranged from a high of 59 percent in listening comprehension vocabulary to a low 
of 9 percent in speaking expression (English stimulus, scored on entire response). 
Whereas the overall achievement on all tests was low, the students did consider- 
ably better in listening comprehension than in speaking. 

Listening Comprehension 

The only listening test administered was the listening comprehension vocabu- 
lary test. The mean score was 59 percent of the maximum possible score. The 
dispersion of scores on this test was considerable. Table 91 • containing a fre- 
quency distribution of scores, shows that lU percent of the students achieved 8l 
percent or higher; 37 percent of the students obtained scores between Cl and 80 
percent; and 50 percent of the students scored 60 percent or lower. 

Performance on the midterm listening comprehension vocabulary test (lexical 
items learned during the first half of the course, through Lesson U5) was not 
significantly different from performance on the test when given at the end of in- 
struction. Apparently, what was learned during the first half of the course was 
retained as new material was introduced, but learning of first-half material did 
not increase significantly during the second half of the course. 

Frequency distributions of scores on the midterm vocabulary and grammar tests 
for both the midterm performance and the final performance are shown in Tables 92 
and 93. 

Speaking 

Achievement on the speaking expression tests was extremely low. The four 
mean values were all under 19 percent of the maximum p^^ssible score, varying from 
9 to 18 percent. The results were about the same whether an English or Spanish 
stimulus was used to elicit the student Spanish response. There was little vari- 
ability in performance, with all scores falling at the low end of the scale, as 
can be seen in Tables 9U through 97. The speaking expression results were lower 
when scoring was on the entire utterance than when based on a minimal acceptable 
response . 

In pronunciation, performance in mimicry (mean of U3 percent) was better 
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tham In constructed rssponse (mssn of 27 percent). The constructed response scores 
however, were depressed heceuse the students did not respond to soioe Iteas, end, 
consequently, could receive no credit for pronunciation in these cases. 

Frequency distributions of scores on the pronunciation tests are shown in 
Tables 98 and 99* 



Interest and Confidence 



There were no significant differences between mean pre- and postinstruction 
interest or mean pre- and post instruction confidence. However, the correlations 
between the pre- and postinstruction scores were low (.37 for interest, and .37 for 
confidence ) . 



Class Achievement 



Tables 100, 101, and 102 present selected student, teacher, and classroom 
characteristics respectively in relation to a rank ordering of class mean scores 
on the final listening con^rehenslon vocabulary test. No class results were ana- 
lyzed for speaking tests because no more than a few students in any one class took 
these tests. Independent variables were chosen for this presentation on the basis 
of having some degree of variability among classes. 

In Table 100, it can be seen that there was considerable variation among the 
class mean scores on the final listening comprehension vocabulary test. The class 
which scored the highest had a mean of 79 percent of the maximum possible score, 
compared to a mean of 27 percent for the class which scored the lowest. 

Student characteristics presented in this table as cIms means, however, 
showed no relationship to the rank ordering of classes by achievement. For example 
it can be seen that there was relatively little dispersion among class mean IQ 
scores. The highest was 119.6, the mean for the sixth-ranked class in achievement. 
The lowest, excluding one class which wan obviously atypical (scoring more than 20 
points below the next highest class), was 103.7 > the mean of the eighth-ranked 
class. Ten of the classes clxistered in the area of 109 to 112, and these were 
distributed more or less reguleorly throughout the rank ordering. 

As can be seen in Table 101, none of the teacher characteristics showed any 
significant relationship to class rcuiking. However, in the case of language 
fluency, it can be seen that the teachers of the first five classes in the ranking 
had at least "some fluency" in Spanish. Most of the other teachers, eight out of 
eleven of them, had "little or no fluency." None of the other variables, training 
in Spanish, experience teaching Spanish, and the preinstruction attitude of the 
teacher toward Spanish for sixth graders, showed even a hint of a relationship to 
class ranking. 

In Table 102 can be seen the relationship of classroom characteristics to 
class ranking. There were no clear-cut relationships between classroom character- 
istics and class ranking. However, some data were suggestive. For example, 
regarding the question as to whether or not the class usually held a warm-up 
session prior to the Spanish telecast, it can be seen that among the top seven 
classes in the ranking, six of them held a warm-up session, whereas among the 
remaining ten classes, only three held warm-up sessions regularly. 

Another example is the frequency of student use of English in class, and this 
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veiylittla relationship to achievonent. The four classes in 
« Wy "frequently" or "always," as opposed to "so»etL.es 
tion lowest seven in the ranking, giving the merest sugges- 
learning of Spwishr^ English by the students might interfere with the 



Correlat ion and Regression Ana.iyses 

with of student, teacher, classroom, and district characteristics 

in Table^ lO^inA listening comprehension and speaking tests are presented 

in Tables 103-108. These data indicate that, for predictive nurnoses none of +h- 

thfSus and consistent relationship rith 

of ““delations would be relatively low because of the lack 

few ®°“* interest that a 

!!!. average, and class size all had approximately the 

hidirn$^ r "^“®" particularly the intera^Lri^^rwiabSr 

statistical control^ s’^““ent in the absence of rigorous environmental or 



ables'^w^rrSitL*?^ f'*®"! *‘*^'=‘* <ii"erent combinations of independent vari- 

*"® "®*®- ^ <=°»Puter p^:grr:a:"^p?o;ed 
Indmen^nt intercorrelation matrix and computes the regression of various 

s?on^rnfi * °n a given dependent variable. Hesults of the five regres- 

Sion analyses are given in Table 109, regres- 

seta regression ^alyses, all dependent variables were used and five 

er varLbles^ ?3rninre^ ^ student characteristics; (2) five teach- 

er variables, (3; nine classroom variables; (U) six variables selected by the 

® ®°°^ ®"’’®®* amount of varS in 

frL cSSes?”° *‘*® and (5) six variables 



regression analyses show that combinations of independent vari- 
v^iab^^r "?^!re related to student learning than were any of thrLd^idual 
M ■, suggestion, as can be seen in Table 109, that the combined 

““a highly related to achievement than were 
other groupings. However, the differences among the five multiple regression 
groupies were slight, indicating that any one method of groupi^ irSobabS no 
more efficient in predicting student performance than is Iny otSfr. 



i In eMh case, those variables were selected which the investigators veit. 
™fmarre^t»t“*® ®-«Pt when tl selection 

coemcients, all of which were statisticIll^eqSivafnt!®’'Fo?^rd^ 

and methods used by the computer program to select a "good" subset see 

+ n™®? ’ Begression with Subsetting of 

Variables, System Development Corporation Document FN-6622/0/0, June 1962? 
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sizes of the mutlple regression coefficients indicate that the independent vari> 
ables measured in this study accounted for a relatively small percentage of the 
learning associated with the use of UAE materials. 

Intercorrelations Among All Tests 

Table 110 presents the intercorrelations among all UAE tests. The correla- 
tions between the listening comprehension vocabulary test and the speaking expres 
Sion tests, as well as the correlations among the speaking expression tests, were 
generally high, ranging from .75 to .99* with 10 of 11 values above .80. The 
correlations between the pronunciation tests and all other tests were generally 
low, varying from .l6 to .56. 



Discussion 



The low achievement in listening comprehension and speaking and the wide vari- 
ability in listening comprehension performance presents serious problems of articu- 
lation and raises questions about program improvement €ind development. 

The results of the study indicate that very few students would be prepared for 
the next sequence of instruction. Even if the second year's course contained con- 
siderable review of the first year's material, individueil differences make it un- 
likely that overall performance would improve significantly. It is more likely 
that variability in performance would increase from year to year, presenting in- 
creasingly difficult problems of articulation, especially as new skills such as 
reading and writing were introduced. Many students would fall further and further 
behind in succeeding years. This would be particularly important in the case of 
TV, where the program sequence is fixed, and the classroom teacher is limited in 
what she can do to adapt instruction to class needs. 

The results suggest that modifications to the materials might be needed to 
improve student performance. Appendix C contains student performance data (per- 
centage of students responding correctly) for each specific vocabulary element 
and expression. Those vocabulary elements and expressions which very few or no 
students learned would require special attention. However, modification in the 
amount and type of practice for specific vocabulary elements and expressions 
might not be sufficient. Given the lock-step system and a limited amo\mt of time, 
it may be necessary to reduce the total number of linguistic objectives (i.e., 
set up more feasible goals and provide more practice and greater variety, with 
fewer linguistic elements) if it is seriously desired to reduce the wide varia- 
bility in end-of-course performance. 

Since the UAE television course achieved its listening comprehension vocabu- 
lary objectives to a higher degree than its speaking objectives, the question 
arises as to the extent to which procedures could be devised to improve the 
effectiveness of the speaking instruction. Certain inherent limitations in the 
medium would have to be considered (e.g. , essentiedly one way communication, with 
no opportunity for observing and correcting student oral responses). It may be 
that initially TV should concentrate more on listening comprehension, with speak- 
ing practice held to a minimum. This might be especially the case where the 
classroom teacher has little or no command of Spanish. In any case, it raises 
the general question as to whether a certain kind and level of competence in 
listening comprehension is an important prerequisite for optimal progress in 
acquiring skill in speaking. 
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A possible explanation of the results of this study may be that the tradi- 
tional method of preparing a whole semester's course (or a year's course) before 
trying It out on students, and of basing revisions on subjective feedback fr^ 
teachers, Is Inadeq^uate. If we wish to develop materials and procedures that are 
highly effective with a given population of students (l.e., that enable most stu- 
dents to achieve a specified minimal level of performance needed to proceed to 
the next sequence of Instruction), It would appear necessary to try out materials 
unit by unit on the Intended students, basing revisions on a detailed objective 
evaluation of student perfomance. How to accomplish this In the case of TV, 
where considerable expense Is Involved In video-taping or filming lessons. Is a 
problem. Pretesting of each unit might be accomplished through the TV teacher 
working with a class directly , and might Include warm-up and follow-up activities 
by the classroom teacher. 

The following basic question, however, must be answered before valid conclu- 
sions can be drawn concerning the use of the UAE materials with sixth-grade stu- 
dents : To what extent are the results of this study a function of problems 

connected with Initial Implementation of new materials and a new Instructional 
approach (l.e., to what degree were the materials misused due to lack of teacher 
experience)? In other words, are the results representative of what might be 

expected after administrators and teachers have had experience In using the 
materials? 

There Is considerable evidence that the method of using materials Is Impor- 
tant to their effectiveness. In this study there was considerable variation In 
how UAE was conducted In the classroom. Table 102 shows that warm-up and follow- 
up activities prescribed by the course developer were not conducted In seven of 
the seventeen participating classes. In three other classes, warm-up or follow- 
up activities took place, but not both. In only seven classes were both warm-up 
and follow-up sessions regularly used. 

There was also considerable variability among the classes In student response 
to drill conducted by the television Instructor, in whether or not the classroom 
teacher responded along with the students, and, diirlng review sessions on days 
when there was no telecast. In whether or not the classroom teacher modeled 
Spanish utterances. An Important question to be answered concerns the extent to 
which the classroom teacher can be trained and motivated to perform effectively 
those functions recommended by the course that should take place before, during, 
and after each telecast. It would seem highly desirable to repeat this study in 
school districts that have various amounts of experience in using the course 
before drawing definite conclusions. 

Limitations In the Interpretation of Results 

In assessing the results of the study , a number of limitations must be con- 
sidered. The implications drawn from the results must be qualified by the size of 
the sample participating in the final testing (l.e., 366 in listening comprehen- 
sion and only 56 in speaking). Lack of experience in using new materials an d a 
new instructional approach is another consideration. Orientation sessions for 
teachers were very brief. The field consultants held teacher orientation meetings 
prior to the beginning of instruction, but it was impossible to hold meetings 
between teachers and authors until several weeks after instruction had begun. 
Teachers began instruction in most cases with insufficient information concerning 
course objectives, materials, procedures, and the handling of equipment. 
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Materials for use with the TV program were not received by some classes 
until well after the starb of the semester* Until the materials arrived, teach- 
ers conducting these classes had to improvise warm-up and follow-up activities* 

TV reception in some schools was not of desired quality. Reports from consultants 
indicated that a few classes missed telecasts because of field trips* 

The use of a tape recording for presentation of the Spanish stimuli on the 
listening comprehension test may have caused a problem for the students who were 
used to receiving auditory stimuli from the TV teacher* Although recordings were 
used during review sessions on days when there was no telecast, there may be a 
need^ for more systematic weaning from an ’’audio-visual” presentation to an ’’audio- 
only presentation for students at this grade level* Furthermore, recording 
student oral responses during individual speaking tests may have caused apprehen- 
sion and inhibition on the part of some students. Another possible limitation 
was that the UAE materials were originally designed for fifth graders, but were 
used in this study with sixth graders. 

Still another consideration is that the length of the listening comprehension 
^cabulary test may have caused fatigue in students, resulting in depressed scores* 
There was also a general limitation inherent in this type of testing in that 
students were responding to isolated utterances outside of the situational con- 
text found in both normal conversation and, to a considerable degree, in the 
instruction* * 
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FREQUENCY DISTRIBUTION OF SCORES ON FINAL UAE 
LISTENING COMPREHENSION VOCABULARY TEST 

^ Percentage Percentage 

of Items of 

Correct Students 



91 - 100 1*6 

81 - 90 12.0 

71 - 80 13 .^ 

61 - 70 23.2 

51 - 60 20.8 

kl - 50 1^.2 

31 - UO 9.3 

21 - 30 3.6 

11 - 20 *8 

0 - 10 1.1 

100.0 
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TABLE 92 



FREQUENCY DISTRIBUTION OF SCORES ON MIDTERM UAE 
LISTENING COMPREHENSION VOCABULARY TEST 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



Q1 - 100 


1.5 


fll - 00- 


12.6 


71 . ftO - 




6l « 70 




«51 • 60 


23.9 


Ill . SO 




“^1 « liO 


5.9 


PI « 10 - 


1.5 


n « 20 


8 


n - in 


0 


99.9 
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TABLE 93 

FREQUENCY DISTRIBUTION OP SCORES ON MIDTERM UAE 
LISTENING COMPREHENSION VOCABULARY TEST 
(as pcurt of final test) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 


k.6 


81 - 90 


.. 19.^ 


71 - 80 


.. 21.9 


6l - 70 


.. 22.4 


51 - 60 


.. 13.1i 


Ul - 50 


.. 10.1 


31 - UO 


.. 5.7 


21 - 30 


.. 1.1 


11 > 20..... 


.8 


0 - 10 


.6 



100.0 
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TABLE 9h 



FREQUENCY DISTRIBUTION OF SCORES ON FINAL UAE 
SPEAKING EXPRESSION TEST 
(English stimulus, minimal response) 



Percentage 
of Items 
Correct 



91 - 100 , 
81 - 90., 
71 - 80.. 
6l - 70.. 
51 - 60 .. 
hi - 50.. 
31 - Uo.. 
21 - 30.. 



11 - 20 , 



0 - 10 , 



Percentage 

of 

Students 



0 




8.6 

12.1 

19.0 

60.3 

100.0 
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TABLE 93 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL UAE 
SPEAKING EXPRESSION TEST 
(English stimulus, entire response) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 




8l - 90 




71 - 80 




6l - 70 




51 - 60 




Ul - 50 


0 


31 - UO 


1.7 


21 - 30 


10.3 


11 - 20 


2U.1 


0-10 


. 63.8 
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TABLE 96 

FREQUENCY DISTRIBUTION OF SCORES ON FINAL UAE 
SPEAKING EXPRESSION TEST 
(Spanish stimulus, minimal response) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 




81 - 90 




71 - 80 




61 - 70 




51 - 60 




hi - 50 




31 - UO 




21 - 30 




11 - 20 




0 - 10 





100.0 
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TABLE 97 

PREQUHTCY DISTRIBUnOH OP SCORES OH FIHAL UAE 
SPEAKIHG EXPRESSION TEST 
(Spanish sl^imulus^ sntlrs r6si>on8s) 



Percentage 
of Items 
Correct 


Percentage 

of 

Students 


91 - 100 


0 


8l - 90 ,,,,, 


• 0 


71 - 80 


• 0 


6l - 70 


• 0 


51 - 60 ,,,, 


• 0 


hi - 50 


. 3.k 


31 - 40 


. 17.2 


21 - 30 ,,,,, 


. 13.6 


11 - 20 


. 17.2 


0 - 10 


. 1*8,3 



99.9 
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TABLE 98 

FREQUENCY DISTRIBUTION OP SCORES ON PINAL UAE 
SPEAKING PRONUNCIATION TEST 



Percentage 
of Itoas 
Correct 


(mimicry) 

Percentage 

of 

Students 


91 - 100 . • 




• 

• 

• 

0 

o\ 

1 

H 

GO 




• 

• 

• 

0 

GO 

1 

H 




61 - 70... 




51 - 60... 




Ui - 50... 




31 - uo... 




• 

• 

• 

0 

cn 

1 

H 

CVJ 




• 

• 

• 

0 

CVJ 

1 

H 

H 




• 

• 

• 

0 

H 

1 

0 





100.0 
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TABLE 99 



FREQUENCY DISTRIBUTION OP SCORES ON PINAL UAE 
SPEAKING PRONUNCIATION TEST 
(constructed response) 



Percentage 
of Items 
Correct 



Percentage 

of 

Students 



91 - 100 



0 



8l - 90 0 

71 - 80 1.7 

61-70 0 

51 - 6o 5.2 

*»1 - 50 15.5 

31 - ^0 20.7 

21 - 30 13.8 



11 - 20 



2U.1 



0-10 



19.0 



100.0 
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TABLE 100 

STUDENT CHARACTERISTICS IN UAE CLASSES, SHOWING THE DISTRIBUTION 
OF MEAN CHARACTERISTICS ACCORDING TO A RANKING OF CLASSES BY 
MEAN SCORE IN FINAL LISTENING COMPREHENSION VOCABULARY* 



Class 

Rfuik 


Mean Score 
As Percentage 


Student Characteristics 


of Maximum 
Possible Score 
in Listening 
Vocabulary 


Mean 

IQ 


Reading 

Grade 

Placement 


1 


78.91 


110.86 


6.65 


2 


75.06 


112.92 


6.06 


3 


72.05 


112.72 


6.1+1 


k 


70.36 


110.90 


6.15 


5 


68.^5 


110.96 


6.10 


6 

4 


67.30 


119.60 


6.66 


1 


62.1+0 


107.77 


5.58 


8 


61.0I+ 


103.66 


5.75 


9 


60.03 


111.65 


6.12 


10 


59.70 


109.75 


6.52 


11 


57.70 


109.57 


6.18 


12 


5U.1+7 


IOI+.I+I+ 


6.33 


i: 


51+.38 


115.06 


6.63 


Ih 


53.21 


110.69 


— 


15 


1+7.05 


105.70 


5.70 


l6 


1+1.60 


85.62 


2.33 


17 


26.92 


110.67 


6.12 



*No class results were analyzed for speaking tests because no more 
than a few students In any one class took these tests. Independent 
variables^ were chosen for this presentation on the basis of having some 
degree of variability among classes. 



ERIC 








m^r: 






173 



H 

O 



s 

s 




I 5 
fl s 

•H ,0 
CO 0) 

■S -*3 

g-^ 

18 

4> 

“ g 

> *H 
e8 

eJ *8 
0) 

S CO 
O 

S & 
gis 

O h 
V 

|S 
t s 
5-8 

jS S 

8 S 

-P • 
0.^ W W 
U) 0) 0) 
0 H to 

28 3 
S.S “ 

CO > bO 

. S 

£ ^ i 

^■s ® 

?8^ 
M &*H 
^ W H 

fl'S-H 



S 



8 



CO 



s .. 

fl) +> 
> CO 
0) 
10 -P 
•P 

M w 

C5 



CO 

' O 
fl) 



fl) 

CO 

fl) 



& 



« 

TJ 



ili 



£ 3 



• H 



■P CO 

2 




H CM 00 ^ lAVO 



a 

fl) 



fl) 



*8 



fl) 

rQ 



|4i 

Xi *H 

s S 

^ *8 ® 

8 S.'^rS 

8 J-'I 

S 3 II 



H CM CT)jst 



U «) 

8 % 



>»-p -e 



£!J!llig 



CVj fO-aJ* 




o ^ fl) 
a V fl 

h § h 

o 3 o 



O 



8 



^ i -p 

a|g 



^ CM <n 



o 

ERIC 



101 continued 









17 ** 




o 

ERIC 






O 

ERIC 



CVl 

o 



a 

i 






8»i5 




(iCep Ai-uou) 

ss«xo u-p 

qsiiSua 
JO 98H 
ipuspti^pg 



n CO 
0 ) 9 > 

as 

•P 



CO 



n >» CO >» CO >> 






Jsis Jsils 

ilB'IMI 



(iCep Ai-noii) 

ss«XD 

qsxxSua 

JO aen 
JSllOBQj; 






‘S'S S. -Pwraco 

H ' si ' I' III!' lll^ 

Ii§ “if ^ 



(^p Al-uoii) 
Tspow 
Sujsiaadg 
sv sdAjag 
jaqoBsji 



(0 CO to CO 
« « I 0 ) 0 ) 
>H >H >4 >4 



, CO CO ea 

I 0 ) 0 ) o o 

>-« >4 H W 



' & S S S 



uoxq.onjq.sui 
AJi o% 
asuodsa^ 
jaqoBsj; 

uoojssaxO 



CO CO 
0 ) 0 ) 
>H 



coco CO 

>-i> 4 $H>-i> 4 >>l>-|> 4 S 2 $>-i>-ifeE;> 4 tB; 



uoxq.Dnjq. 8 Ui 
Al o% 
asuodsag 
SSBXO 



•P^4fPP%4+»%4+J 

niHMCOCOrHCQHM 
>§ S ^ <S " OfflO 



%4 +» %4 Vi +» Vi 

'iSSTi'isiTn 



POXJScJ 
dn-AOxxoj; 
JO asfi 



CO CO CO CO CO 

0) 0) 0) 0) o 

>H >4 H >1 >H 



^ _ CO CO 

5 *0 O 0) O O 0) 

fss ^ fis ^ ts 



o o o 
» ^ ^ 



POXJSd 
dn-injB/4 
JO asn 



CO^CQCQCOCQCO CO m m 

O oSo oSo S O 



0) 






epgi&SSScgs 



CO 



3| 

dl 



Hcvicn^irkvot^oboNOHcvi co^ iavo t- 






(0 



I 



fi 



n S 

Pi 0> 
CO $ 






§ P 

C • 

- ^ CO 

o *d o> 
H a CO 

O QJ CO 
> Pi cd 
_fl) H 
CO Id u 
+> p 



CO 



s 



0) 43 
4^ «H 



O 0 ).H 

^ W fP 

•2 2 
g; ,a *H 

• p H 



2 



175 



TABLE 103 

CORRELATION MATRIX SHOWING RELATIONSHIPS OF STUDENT CHARACTERISTICS 
TO LISTENING COMPREHENSION TEST PERFORMANCE IN UAE CLASSES 
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• Correlations computed from code with 1 equal to male and 2 equal to female , so that positive 
correlations suggest slight female superiority. 

^ This is a socio-economic scale. 



CORRELATION MATRIX SHOWING RELATIONSHIPS OF STUDENT CHARACTERISTICS 
TO SPEAKING TEST PERFORMANCE IN UAE CLASSES 
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CORRELATION MATRIX SHOWING RELATIONSHIPS OF CLASSROOM AND DISTRICT CHARACTERISTICS 

TO SPEAKING TEST PERFORMANCE IN UAE CLASSES 
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simplify presentation, the decimal point is not shown. Each coefficient is carried to the nearest 





CHAPTER VIIT 



COST FACTORS 



EquiTMient and Materials 

In order to gather data on the cost of implementing each of the three in- 
structional programs in terms of both time and money, a questionnaire was sent 
to the superintendents of all participating districts. A copy of this question- 
nalre can be fotmd In Appendix D* 



The cost of implementing the Spanish courses varied considerably fr^ dis- 
trict to district and from course to course. If we take the cost of ns a g 
a given course per class for each district and then average the cost per class- 
room across districts, we may obtain an index of the cost per classroom for each 

course • 



It should be pointed out that this is a weighted average, since the averap 
cost per class was computed for each district as a preliminary step and then the 
average cost across districts. This procedure resulted in those districts with 
only one class in a given method having equal weight with a district conducting 
two or more classes. Therefore, the per class average gives less we g o 
classes which are only one of two or more operating within a district. 



It may be assumed that the cost per class decreases to some extent as the 
number of classes in operation increases. Equipment, such as tape recorders, 
can be used in more than one class, and many types of materials can be used more 
than once. The weighting swings the average in the direction 
situation, so that it would tend to be increased slightly over what it would be 

if unweighted. 

The purpose of the weighting was to reflect the fact that the one-class 
situation tended to be the more prevalent one and, therefore, it could ^p®^» 
was more typical. It could be argued with equal validity, however, that districts 
seeking to implement a course of instruction in something more than a pilot pro- 
gram will in most cases have more than one class, and so the multiple class situ- 
ation might be thought to be more typical. 



If we had a good distribution of districts in terms of the number of classes 
using a given program, we could control for the number of classes involved and re- 
port the cost per class based on the number of classes implemented. However, the 
extremely skewed distribution of districts did not allow this. The modal number 
of classes in a district was one, and the majority of districts were restricted to 
no more than two classes in a method. 



MLA. Table 111 shows the average expenditure for equipment and materials per 
classic* each course of instruction. In examining the cost of equipment and mater- 
ials for districts which installed MLA classes » it can he seen in Table 111 
there was a range from $8 to $526 per class, with a mean expenditure of about $160. 



Obviously, the cost must depend upon three major factors! 1) how much equip- 
ment and ainterials the district has on hand: 2) how much the district is willing 

able to spead for new materials and equipment; and 3) how many students they 
wish to include in the program. These factors are not independent of one another. 
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TABLE 111 



AVERAGE EXPENDITURE FOR EQUIPMENT AND MATERIALS 
PER CLASS BY COURSE 



Approach 


Average 
Expense 
per Class 


Range in 
Expense 
per Class 


MLA 


$ 160 


$ 8-526 


UAE 


375 


38-683 


SPA 


U. 3 U 3 


1 , 763-11,201* 
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The expense depends upon the importance given to a foreign language program by a 
particular district more than anything else. The factors influencing the impor- 
tance given to a foreign language program were not determined. 

The district which spent $8 had only one class and purchased only a teacher's 
guide to Beginni ng Spanish in Grade Three and a phonograph record for use in that 
class. This represents the minimum possible expenditure for MLA materials. The 
district which spent $526 per class had one class and purchased, in addition to 
teacher's manuals and records, a record player and a tape recorder. 

UAE t It can also be seen in Table 111 that the cost of equipment and mater- 
ials for UAE classes varied from $38 to $683, with a mean expense of $375* The 
district that spent only $38 on equipment and materials already had the tele- 
vision equipment installed and needed only to purchase teacher's guides, records, 
and pupil booklets. However, one district spent $U,500 for television sets. 

This district also purchased TV carts, antennae, cables and conduit, boosters and 
spent close to $2,300 for a contract with an educatlonel TV station in order to 
be able to receive the Spanish telecast. The cost per class, however, was under 
$300. This district had a total of l8 classes in operation. 

SPA . The average expenditure for equipment and materials per Spanish A 
class varied from $1,763 to $11,20U, with a mean of $U,3U3, as shown in Table 111. 

Basic to the SPA program were the lesson booklets, offered at the price of 
$ 29.25 per set, and the tapes, offered at $113 «U0 per set. In addition to these 
essential materials, a district needed tape recorders equipped with foot-operated 
start-stop pedals and audio-active earphones. Tape recorders vary considerably 
in price. The model most generally used in the project was equipped for audio- 
active microphone and headset, at a unit cost of $200. The audio-active micro- 
phone and headset came to a price of about $U0. The foot-operated start-stop 
pedal cost about $20. 

With the expensive equipment necessary to the operation of SPA, a major 
question was the number of student stations to be equipped. Since the instruc- 
tion was self-administered by the student, the number of students that could 
participate at any one time depended upon the number of tape-recorder stations 
available. Some teachers allowed part of the class to take SPA while other 
students engaged in another activity. 

Individual booths and the installation of electrical outlets, in the con- 
struction of a language laboratory, cost relatively little, though here again one 
could spend considerable money on remodeling if it were so desired. For example, 
a typical laboratory set up with eight stations, including special tables, elec- 
trical outlets, extension cords, plywood partitions, and the labor to construct 
the booths and paint them, came to about $790. The most expensive item here, of 
course, was the tape recorder, particularly if one was purchased for every student 
participating in the program. It is obvious that equipment is far more crucial in 
this program than in the others, though naturally the television set is Em indis- 
pensable item in UAE classes. For the district averaging $1,763 per class, the 
expense was Incurred in the purchase of booklets, tapes, and 17 tape recorders, 
and the stau:t-stop pedal and Eiudio-active headset for each. The totad cost for 
this district came to $5,289, but with three classes in operation, the cost per 
class was one-third this amount. 

The district that spent $11,20U per class used its money for essentially 
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the same kinds of materials and equipment, but the quantities were greater. This 
district had Just one class and purchased Uo sets of tapes and booklets, Uo tape 
recorders at $122.50 apiece, and Uo sets of audio-active earphones. The major 
items were tapes and tape recorders. Here again, it becomes obvious that the 
amount of money spent depends primarily upon the administrative decision regard- 
ing the extent to which foreign language should be implemented at the elementary 
level. It must be remembered, however, that the data for this study were gathered 
during the instructional year immediately preceding the first year of mandated 
foreign language instruction at the elementary level. 

Cost figures were examined further on the basis of district characteristics, 
i.e., in terms of the average cost per class of operating a particular program 
within districts of given characteristics of size, population density, and type 
of state aid received. There was a slight suggestion in the data that the small, 
rural district tended to spend less money in the project than did the large, 
metropolitan district, though the number of small, rural districts in the study 
was very low, no more than two for each course of instruction. 

Cost in relation to size, population density, and type of state aid received 
are shown in Table 112. As can be seen in the upper third of the table, there is 
the suggestion that cost was an increasing linear function of the size of the 
district for both MLA and SPA classes. The relationship for UAE classes was curvi- 
linear, however. Though the large districts using UAE tended to spend more than 
the small districts, the medium sized districts tended to spend more than twice 
as much money as did the large districts. 

Cost in relation to the population density of the district, shown in the 
middle of Table 112, was slightly curvilinear for both UAE and SPA classes, with 
the urban districts tending to spend more money than the metropolitan districts. 
However, the metropolitan districts in all three approaches tended to spend more 
money in the project than did the rural districts. 

Type of state aid received also showed a curvilinear relationship to the 
amount of money spent in the project for both UAE and SPA classes, with districts 
receiving equalization aid tending to spend less money than those receiving either 
basic or supplementary aid. For MLA classes, the relationship was linear, with 
districts receiving supplementary aid tending to spend more. 

There was a high positive correlation between size and population density and 
a negative correlation between type of state aid and population density. Conse- 
quently, the three parts of the table were not independently derived. As mentioned 
earlier, one general conclusion to be drawn from Table 112 is that the small, rural 
district tended to spend less money per class than did the large, metropolitan 
district. 

In-service Training 

Few districts listed any expenditures for in-service training. In a few 
cases, the cost of in-service training was absorbed by the teachers involved. 

One district listed a mere $15 for in-service training, operating 6 classes 
using MLA materials. Another district, however, listed $1,656 for in-service, 
for 9 classes. In this particular instance, the figure reflects the prorated 
cost of time spent by the foreign language coordinator of the district in con- 
sulting with teachers in the project, plus the prorated time of teachers spent 
in other than regularly scheduled duties. 













TABLE 112 

AVERAGE EXPENDITURE FOR EQUIPMENT AND MATERIALS PER CLASS BY 
COURSE AND BY DISTRICT SIZE, POPULATION DENSITY, AND TYPE OF STATE AID 



District 

Characteristics 


Course 


MLA 


UAE 


SPA 


Size 








Small 


$ 92 


$172 


$3,665 


Medium 


115 


607 


U.023 


Large 


210 


229 


U,T3l* 


Population Density 








Rural 


92 


172 


3,665 


Urban 


10^ 


U08 


U,666 


Metropolitan 


180 


395 


1»,393 


Type of State Aid 








Basic 


81 


360 


U,252 


Equalization 


150 


292 


3,519 


Supplemental 


> l8k 




4,969 
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The variation in coat for in-service training vaa greater within a particular 
method than between methods. As one would expect, however, there was very little 
cost for teacher in-service training for classes using SPA. The largest in- 
service expense reported by a district using SPA was feoo, and this was again 
based on the cost accounting of district personnel involved in the project. For 
those classes using UAE, the largest expense reported by a district for in-service 
training was a cost accounting figure of $653. 

Maintenance 



The expenditure for maintenance was generally greater for SPA classes than 
for UAE classes, which in turn was greater th*'n for MLA classes, as one might 
expect, because of the relative amounts of equipment involved. For SPA classes, 
tape recorders might need repair, or foot pedals might break down. One district 
spent nearly $500 for repairs and maintenance, but this was exceptional. This 
figure included replacing recorders and headsets, the wiring and installation of 
replaced equipment, and other repairs. One district listed maintenance costs of 
$1,570 for four MLA classes, but this involved extra pay for four Spanish teachers 
who taught Spanish before school officially began each day. The average for main- 
taining classes in SPA was about $63 per class. The average cost of maintaining 
classes in UAE was about $U per class. Maintenance for MLA classes turned out to 
be less than one dollar per class. 

The question might be raised as to what was the overall cost per district 
across methods. Though there was a considerable range between the two extremes, 
most of the costs per district fell into a range between $U,000 and $5,000. This 
includes matching funds under NDEA. The exceptions to this range did not fit any 
particular pattern and would seem to be based primarily on idiosyncratic situa- 
tions within a few districts. 



Time Factors 

An Important part of assessing the cost of using an instructional program is 
the length of time spent by various staff personnel within the school system in 
planning, ordering materials, accounting, maintenance, supervision, in-service 
training and so forth. These costs are rarely reflected in the actual cost figure 
for the implementation of a new program, yet these are very real considerations. 
Administrators were asked, therefore, to give an estimate of the amount of time 
they spent connected with the Spanish languege research project. It was impossible 
after the fact for them to analyze the amount of time allotted to each individual 
course, where more than one course of instruction was used in a particular school 
system, or to determine the amount of time spent on each particular type of activ- 
ity. It was thought sufficient to ask, in general, for an estimate of the length 
of time spent on activities related to the project. 

However, for those districts that had only one course of instruction involved 
in the project, it was possible to indicate how much administrative t im e was spent 
on each course. Table 113 shows this data. It can be seen in the table that, in 
general, more time was spent on SPA than on either MLA or UAE, in every category 
except supervisors* time during the period of instruction. Somewhat more time was 
spent on MLA than on UAE in every category except the work of a maintenance tech- 
nician. With very little equipment involved, there was little or no maintenance 
time necessary to the operation of MLA classes. As expected, the maintenance 
technician spent relatively large amounts of time in SPA both prior to the begin- 
ning of instruction and during instruction. It can be seen further that MLA classes 
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TABLE 113 



AVERAGE NUMBER OF HOURS SPENT BOTH PRIOR TO THE BEGINNING OF INSTRUCTION 
AND DURING THE SCHOOL YEAR BY VARIOUS SCHOOL OFFICES AND STAFF PERSONNEL 

FOR EACH COURSE 



Personnel 


Prior to 
Instruction 


During 

Instruction 


MLA 


UAE 


SPA 


MLA 


UAE 


SPA 


Superintendent * s . 














office 


1.50 


o.Uo 


8.50 


2.00 


0.10 


7.00 


Business 














office 


0.25 


0.20 


5.50 


0.25 


0.10 


• 1.50 


Maintenance 














technician. • • • 


0 


0.10 


8.00 


0 


o.Uo 


10.00 


Supervisors 


1.00 


0.50 


1.50 


8.0 


1.50 


2.0 


Principals 


1.00 


0.30 


7.00 


2.75 


0.80 


9.00 
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received relatively more attention from supervisors during instruction than did 
either of the other methods. 

As to vhat activities were involved in time spent hy various school offices 
and staff personnel, it was frequently mentioned that district superintendents 
spent time preparing project applications under NDEA, planning for teachers, 
talking to the field consultant for the project, sending purchase orders, prepar- 
ing for the school hoard meeting, visiting classes, and so forth. It is interest- 
ing that only one district mentioned the recruitment of teachers specifically as 
a function of the superintendent, though this activity may have been subsumed in 
some instances under some more general category such as planning for the program 
or planning for teachers. Very few districts actually hired new teachers for the 
project. However, at some stage of the decision-making regarding participation, 
it was necessary to determine what teachers in the district were qualified to 
teach a project class and what was their availability. 

The business office engaged in activities such as packaging and mailing 
materials, preparing purchase orders, authorizing equipment repair, maintaining 
cost records, accounting, handling billing, etc. In some cases, functions of the 
business office were similar to those mentioned for the superintendent. For 
example, business offices frequently prepared NDEA applications. It was also 
mentioned that business offices had corrected test materials and completed stu- 
dent information sheets on student characteristics from cumulative record files. 

Activities for the maintenemce technician included, for UAE classes, in- 
stalling TV antennae, installing and tuning receivers, repairing sets, and check- 
ing rooms and sets. For SPA classes, the maintenance technician installed wiring 
and electrical outlets, adjusted lighting, built booths, installed work tables, 
repaired or made adjustments on cables for foot pedals, euid repaired recorders, 
headsets, €uid foot pedals. 

Supervisors were either foreign language coordinators at the district level 
or a senior teacher at the school level. Their activities included a multiplicity 
of tasks from the splicing of tapes— essentially a maintenance function— to the 
selection of teachers. Predominantly, the task of the supervisor was to coordin- 
ate project activities locally, working closely with the field consultant from the 
State Department of Education and to supervise and orient teachers using the 
various sets of materials. Many of the local super^risors participated in the 
testing phase of the project, orienting teachers in the testing methods or adminis- 
tering tests themselves. It could be said that the major function of the local 
supervisor was in-service training of the teachers. 

-j 

The activities of the principals of schools in the project classes did not 
seem appreciably different from functions already described. It seems that 
principals did very much the same sorts of things that supervisors did: holding 

in-service sessions for teachers, organizing the program, acting as liaison 
between the teacher and the field consultant for the project, checking equipment, 
assisting the teacher in numerous ways, etc. Principals even assisted in main- 
tenance functions, such as troubleshooting equipment, or helping to install it 
initially. 

The functions of the teachers have been spelled out elsewhere and will not 
be discussed in this chapter. 



CHAPTER IX 



SUMMARY AND RECOMMENDATIONS 



Summary 

The purpose of this project was to develop absolute assessment procedures as 
a basis for making decisions about selecting a Isuiguage course, developing improved 
instructional materials, modifying learning conditions, and revising course objec- 
tives. It was designed to obtain greater objectivity in evaluating achievement 
in the four basic language skills (i.e., listening, speaking, reading, and writing) 
than had been possible with existing methods. 

A field test of three different approaches to teaching Speuiish to sixth-grade 
students was conducted. The three approaches were: (l) instruction by a quali- 

fied foreign language teacher (MLA language course); (2f programmed self-instruc- 
tion (SPA language course); and (3) instruction by television (UAE language 
course). A total of 28 different tests were developed for the three Spanish cours- 
es (MLA— 8; SPA— 16; UAE— U). These tests were unique to each course of study. 

They were not used to compare the three courses of instruction with each other, but 
were designed to evaluate the extent to which each language course achieved its 
own objectives under specified learning conditions. The test instruments are re- 
ferred to as criterion-referenced tests. They are based on an absolute criterion, 
rather than a relative standard of achievement. 

Each of the four basic language skills was evaluated separately. Within each 
skill separate tests were developed for vocabulary and grammar. Procedures were 
developed for scoring the speaking and writing tests which increased objectivity 
and changed the scorer's role from decision-making to rule -following. 

This study demonstrated the feasibility of criterion-referenced testing as 
applied to a large scale field test of three foreign language courses. It indi- 
cated that the traditional method of evaluating only a small sample of the speci- 
fic linguistic objectives of a language course may obscure serious deficiencies in 
materials and/or learning conditions. The test results in the study showed that, 
with few exceptions all three language courses failed to achieve their basic 
linguistic objectives under the learning conditions involved in this study. 
Substantial modifications to materials ar.d/or learning conditions would be required 
to achieve the goal of having almost all students acquire sufficient mastery of 
the basic language objectives to profit from the next sequence of instruction. 

The results also showed that in all coiirses listening comprehension objec- 
tives were achieved to a greater degree than speaking objectives, vocabulary 
greater than grammar, grammar greater than grammar transfer, and in pronunciation 
mimicry greater than constructed response. Finally, the data indicated that, for 
predictive purposes, none of the independent variables showed a consistently 
strong relationship with the various test scores. This supports the frequently 
stated view that the factors involved in foreign language learning under usual 
classroom conditions are complex and that degree of success in learning a foreign 



^ The exceptions were the SPA vocabulary tests in listening comprehension and 
reading . 



193 



19U 



language cannot be predicted accurately from any individual independent variable. 

It was found that multiple regression analysis increased the level of pre- 
dictability somewhat over that reached through the use of any single independent 
variable. However, even an extensive multiple regression analysis in which differ- 
ent combinations of independent variables were tried did not produce predictabili- 
ty of a level that would be useful in a practical school situation. It may very 
well be that it is necessary to design studies to examine the interactions among 
independent variables if predictability in an uncontrolled setting is to be 
increased much beyond the levels found in this study. 

Recommendations to School Districts 

Schools should not assume that substantial numbers of students learn all, or 
even most, of what is "covered" in a given course. 

The strongest recommendation that can be made is for the establishment of 
a continuous evaluation-revision cycle as an empirical basis for modifying learn- 
ing conditions, instructional materials, or objectives. There is a need to depart 
from the traditional approach of evaluating students for the purpose of assign- 
ing grades. Instead, an experimental attitude should be adopted in the classroom. 
The emphasis should be on evaluating the instruction rather them the students. 

The recommended evaluation-revision cycle should include the detailed specifica- 
tion of objectives, coD^rehensive evaluation of achievement, and continual adap- 
tation of the learning situation in accordance with the data collected. This 
cycle should be continued until all or nearly all of the students are achieving 
the minimal level of performance which has been specified as necessary for satis- 
factory progress in the next course. 

The development of criterion instruments and of the entire evaluation-revision 
process for developing effective instructional materials will be costly in money 
and manpower . However , since many school districts use the same materials year 
after year, it is strongly urged that Joint efforts at county, state, and national 
levels be undertaken to develop the necessary instruments and techniques. (The 
tests developed in this project can serve as a model for developing similar evalu- 
ation instruments adapted to the specific content of other courses.) As more 
districts participate, more data will be accumulated on which to base course modi- 
fications, €ind the evaluation-revision cycle will be accelerated. 

Dramatic improvements will not come overnight ; a mamber of years and much 
diligent effor'J^ will be required for significant progress to take place. However, 
to continue with the typical end-of-course student evaluation and grade assign- 
ment (ignoring the problems implicit in the wide range of student performance) is 
to resign ourselves to producing only a handful of high school and college gradu- 
ates who have acquired anything approaching a functional command of a second 
language . 

Criterion-referenced tests measured the learning of specific vocabulary, gram- 
matical, and phonological elements in a course of instruction. Teachers should 
use these tests in three ways; (l) to provide diagnostic information on a given 
student's learning and learning difficulties; (2) to suggest modifications to 
learning conditions, instructional materials, or objectives for the next group of 
students receiving the instruction Just evaluated; and (3) to provide a basis for 
grouping students for subsequent instruction. 
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Further , school districts should urge teachers to follow the procedures re- 
commended by the course developer as closely as possible so that baseline data 
can be obtained on the effectiveness of the course when used as intended* Major 
departures from recommended procedures , along with the reasons for such changes , 
should be recorded so that the feasibility and adequacy of the procedures can be 
analyzed. The systematic use of special supplementary materials should also be 
noted. Where achievement varies significantly from year to year, the Information 
on changes to the course will aid in attenqptlng to analyze underlying causes. 

School districts should require from publishers more explicit Information 
on course objectives and course effectiveness than is currently provided. A 
more detailed statement concerning this point can be foimd in the following sec- 
tion. 



Recommendations to Course Developers and Publishers 

Published materials should contain an explicit statement of course objec- 
tives. Despite varying conditions under which the materials are to be used, the 
course developer should state the number of vocabulary, grammatical, and phono- 
logical elements the student is expected to control at the conclusion of instruc- 
tion. The specific linguistic elements should be identified, classified, and 
listed. The objectives should be further described in terms of the manner in which 
the student should be able to control the linguistic elements, the conditions under 
which he should be able to perform, the level of performance that will be consid- 
ered satisfactory, and the means by which satisfactory performance can be recog- 
nized. The minimum level of performance necessary for a student to progress to 
the next sequence of instruction should be specified. Where applicable, a dis- 
tinction should be made between specific minimum and maximum course objectives. 

Data should be furnished in the instructor's manual on the amount of prac- 
tice provided for each linguistic element representing a course objective (i.e., 
the number of lessons and exercises in which the element appears, indicating the 
number of times the element is the prime objective of the exercise and the number 
of times the element is Just used incidentally). These data, in conjunction with 
student performance data, can be used to evsduate the effectiveness of specific 
types of practice in teaching particular language features and in establishing a 
hierarchy of difficulty for these features. 

The target population for which the course is designed and the learning 
conditicms necessary for its effective use should be described. Data concerning 
the effectiveness of the course under specified conditions should be included, and 
the criterion instrument used should be available for course users. In effect, 
the type of field testing conducted in this study would ideally take place prior 
to final publication and commercial distribution of instructional materials. 

At the end of each unit in an instructional sequence, tests should be pro- 
vided indicating the minimum level of performance necessary for students to ad- 
vance to the next unit in the sequence. This would be helpful to schools, using 
the materials under varied conditions, in determining the pacing appropriate for 
their local situation. 

The development of materials that will enable most students to achieve a 
specified minimal level of performance presupposes an empirical evaluation-revi- 
sion cycle in which each lesson is pretested on students from the target popula- 
tion, and in which revisions are based on a detailed, objective evaluation of 
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student performance. This type of empirical approach to material construction will 
most certainly increase developmental costs, and these increases will eventually he 
reflected in the retail cost of the product. However, in the long run the economic 
efficiency of this process will he much greater than that of the traditional approach, 
in which money may he spent year after year without sufficient information regard- 
ing the effectiveness of the instruction. An effort of the magnitude prescribed here 
is necessary if larger numbers of students are to he provided with a successful for- 
eign language experience. 
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APPENDIX A 

MLA COURSE OBJECTIVES AND 
STUDENT PERFORMANCE DATA 











Qb.1ectives from Published Course 

The statement presented below is an excerpt from the introduction of the MLA 
Teacher *s Guide . ^ 

1. Real Spanish. This course of study is planned to enable a competent 
teacher to teach as much spoken Spanish as an average eight-year-old child can 
learn with pleasure in a year's time. The guiding principle is the teaching 

of real Spanish in a situation which is natural to the child, but constant atten- 
tion has been given to the broader outcomes, such as cultural penetration, of 
second language study. 

2 . Objectives. The benefits which accrue to a child who learns a second 
langu€ige are of at least two types; linguistic and cultural. Insofar as these 
can be separated. The objectives of a course to teach the child a second language 
should be to communicate these benefits efficiently and with pleasure. 

2.1 Linguistic Objectives. Since the guiding principle is the teaching of 
real Spanish in a situation which is natural to the child, no simplification of 
the language has at any time been introduced. The utterances are manufactured 
only in the sense that they have been kept short and situationally confined. 
Absolutely no restriction of a grammatical or structural orientation has been im- 
posed in the evolution of the dialogues. All utterances are equal in the sight 
of the child and can be mastered without regard to order of logical complexity so 
long as they are of no greater complexity of content than the English utterances 
which he is already capable of making. 

The problem of language learning is the acquisition of speech patterns rather 
than the acquisition of words. "Acquisition” means "mastery as habitual stimulus- 
response behavior without necessity for conscious thought." The emphasis in this 
Guide is therefore on the most varied possible manipulation in realistic contexts 
of only as much vocabulary as can be readily assimilated in the time available. 

All logical and pedogogical assumptions were taken as subsidiary to that of 
having the child hear and imitate, at all times, the manners and styles and levels 
of speech which would be realistic facsimiles of the speech of native Spanish- 
speaking children of the same age and interest group. 

2.2 Cultural Objectives. All of the belief and behavior patterns which a 
group of people living together share are their culture . Patterns of cultural 
behavior cluster around focal areas of activity, including materials and artifacts 
defense, recreation, learning, the use of time and space, interaction of the 
sexes, work, societal groupings like the family, and communication through sym- 
bolic systems such as language. The critical facts about culture, from the edu- 
cational point of view, are that most of the patterns which make it up are out 

of awareness, and that those patterns which are awareness are usually accepted 
as cultural universals. It is therefore the tendency of participants in one 
culture to impose their belief systems on those of another, or to assume that 
"people are pretty much the same all over the world." In some ways, of course, 
they are, but in the ways of culture the differences are more numerous, and usu- 
ally of more consequence, than the similarities. 



^ Material in this section is quoted from MLA Teacher * s Guide ; Beginning 
Spanish in Grade Three. Mildenberger, K. (Ed."} ( Educ at i onal Publishing 

Corpor at ion , Darien , Conn . , 1958). By permission of the publisher. 
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One of the most far-reaching benefits of second-language teaching in the 
elementary school is the break-through toward something broader than mono-cultural 
orientation. Even though statements about the culture of Spanish speakers may 
never be made in teaching the child to speak Spanish, he is learning to manipulate 
the tool which both reflects and transmits the culture of those to whom the lan- 
guage is native. He is learning that the differences between two cultural systems 
(English and Spanish) are arbitrary, not logical; that a system which differs 
from his native system is neither odd nor inferior, but just different; that his 
own language slices up the world of experience in a way that can claim no 
unique validity; that ways of thinking differ as do ways of speaking, and perhaps 
in proportion to those differences; he is, in short, developing an attitude of 
cultural relativism. But he is not developing this attitude by hearing about it. 
The objective is not primarily to communicate simple cultural facts nor even to 
develop appreciation of Hispanic culture. The objective is to reduce mono-cul- 
tural orientation by active, pleasxirable participation in a different cultural 
pattern. 

Course Author': Statement Supplementing Published Course Objectives 

The material presented below was obtained from the course author at the 
beginning of Project D-177 to supplement the statement of objectives in the 
introduction of the published teacher's guide. 

General 



A. To present the Spanish language to eight-year-old children in a form that 
is natural and accurately related to contexts familiar to Spanish-speaking 
children of the same age. 

1. The form of the language should be realistic — representing the kind 
of language performance children use and need. 

2. The interpretation should also be natural, and eveiy effort should 
be made to encourage the teacher not to adopt an over-formal or 
precise interpretation in the classroom. 

3. In class the child hears, imitates, and dramatizes capsule situations 
that he can identify himself with. Games, songs, rhymes, and simple 
competitions are added to provide interest and variety. 

U. Emphasis is on participation with identification on the part of the 
student, with learning accelerated by a certain amount of manipulation 
within realistic contexts, though for the most part formal drill is 
postponed until following years. 

B. To begin the presentation of Hispanic culture as a system of beliefs, 
attitudes, values, activities, and social organization different from the 
student's own — and to develop an attitude of cultural relativism that 
accepts new cultural patterns in their own context without judging them 
as being per se inferior or odd. 

The student is encouraged to participate, at least vicariously, in 
cultural patterns that would be appropriate for his Hispanic counter- 
part. 




2 . 



An effort should be made to reduce monocultural orientation by active. 
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pleasurable participation in new ciatural patterns. 

Specific 

A. Students should learn to recognize: 

1. All vocabulary items presented in the course. 

2. All dialogues and the situations they treat. 

3. Substitutions of familiar vocabulary in comparable sentence slots— 

stuLnts?*”**^ and meaningful to the 

Identification of patterns. 

near-natively produced Spanish, recognizing known lexical 
snepd ,* 6^a®nia cal patterns when spoken at normal conversational 

intoMtionretf.*'^^'^°^’^^“*®^^ question patterns of 

B. Students should learn to produce: 

1. Any role in any dialogue, plus all structural filler material. 

Simple substitutions and logical variations in meaningful contexts. 

All songs and rhymes. 

A simple conversation in any area of experience represented by the guide. 



teacher's, if appropriate guidance 
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TABLE llU 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH LISTENING COMPREHENSION 
VOCABULARY ITEM TESTED AT END OF COURSE IN MLA CLASSES, SHOWING THE 
CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


1 


Es grande. 


96 


17 


Es el nene. 


89 


2 


Buenos dlas, nlfios. 


85 


18 


Es un llbro. 


97 


3 


LevAntate, por favor. 


96 


19 


Es la escalera. 


90 


U 


Esta es la sala. 


78 


20 


Es un lAplz. 


96 


5 


Ve a la ventana. 


63 


21 


Voy corrlendo. 


86 


6 


Esta es una casa. 


95 


22 


Esta es una mufieca. 


87 


7 


Me llamo Pedro. 


88 


23 


Ve a la puc*r'ta. 


90 


8 


Son hermanos. 


81 


2k 


Buenos dlas. 


98 


9 


Esta es una escuela. 


95 


25 


Ve a buscar el perro. 


76 


10 


Este es un gato. 


95 


26 


Ve a la pizarra. 


88 


11 


Mira ml pistola. 


97 


27 


SlAntate . 


97 


12 


Es regular. 


87 


28 


Toma este llbro. 


91 


13 


Es la tlza. 


90 


29 


Este es el cuarto 


67 










de Paco. 




lU 


&D6nde estA el bafio? 


67 














30 


Pasa, Peplto. 


87 


15 


Este es un perro . 


89 














31 


Dale la tlza. 


95 


l6 


EstA fuera. 


60 














32 


Hola, nlfio. 


92 



* Vocabulary Items are underlined. The Spanish utterances are listed In the order 
In which they were presented to students on the final test. The required student 
response was a brief Spanish utterance. Only the underlined words were scored. 
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TABLE llU Continued 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


33 


Ya me voy. 


61+ 


51 


Ahora, dale el libro 


57 










a 4l. 




3h 


EstS arriba. 


63 














52 


Es el nOmero cuatro. 


97 


35 


Es la mamd. 


99 














53 


Pues, ya me voy. 


1+6 


36 


Tu perro es pequeflo. 


96 














5I+ 


Subamos a mi cuarto. 


52 


37 


Es una pelota. 


93 














55 


Marla con Luisa. 


1+8 


38 


Es una familia. 


9I+ 




******** 










56 


iQu£ es esto? 


77 


39 


Ve a la mesa. 


87 














57 


Es el nGmero ocho. 


98 


1*0 


Buenos dlas, sefior. 


92 














58 


Por favor. 


81 


1*1 


Es el pap A. 


99 














59 


Plntala de amarillo. 


1+2 


k2 


EstS durmiendo. 


70 














60 


Es marr6n. 


55 


k3 


Juguemos en mi cuarto. 


73 














61 


iQuS quieres? 


57 




Este es un vaquero. 


86 














62 


Es el nGmero dos. 


99 


h5 


Esta es una ventana. 


90 














63 


Hasta luego. 


88 


1^6 


Rebota la pelota. 


79 














61+ 


Si, tengo uno. 


85 


i+7 


Es el nOmero seis. 


96 














65 


De nada. 


75 


1+8 


I Gracias I 


95 














66 


Es una nifla. 


85 


1+9 


£Cu&ido viene papt? 


83 














67 


Es el n(unero diez. 


98 


50 


Es amarillo. 


95 








1 






68 


iDe quS color es? 


95 
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TABLE llU Continued 






j 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


69 


Aq^ul estoy, mamS. 


87 


85 


EstA abriendo la 


59 


70 


Rebota la pelota 


79 




puerta. 






tres veces. 




86 


iCuAntos libros 


73 


71 


ICuidado con la 


65 




tengo? 




escalera! 


87 


Es el nOmero cinco. 


98 


72 


Es el nilmero uno. 


98 


88 


lQ\i$ hago? 


1+0 


73 


Es azul. 


97 


89 


Es cast alio. 


65 


7i+ 


Borra el ”dos.” 


73 


90 


£C6mo te llamas? 


86 


75 


En el cuarto. 


93 


91 


Ella tiene haihbre. 


55 


76 


Es negro. 


99 


92 


Es el nOmero siete. 


96 


77 


Es el nfjmero doce. 


91+ 


93 


Bien, gracias. 


91+ 


78 


Yo soy el sefior G8mez. 


78 


9k 


£D6nde estA? 


. 55 


79 


iQu8 tienes ahl? 


59 


95 


Este es el libro. 


88 


80 


Es verde. 


96 


96 


Cuenta de uno a 


81 


81 


Dile a Juanita. 


51 




cinco. 




82 


Es el nfimero tres. 


98 


97 


Es el nOmero trece. 


9k 


83 


Mira mi pistola nueva. 


83 


98 


EstA cerrando la 
puerta . 


57 


8k 


iCuAndo viene Marla? 


71 


99 


£QuA estA haciendo? 


58 
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TABLE llU Continued 

f 






. 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 




Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


135 


Este es un picnic. 


98 




152 


Son dos manos. 


86 


136 


Hay postre. 


62 




153 


Es un telefono. 


97 


137 


Es came. 


80 




I5U 


Mira, !c6mo salta! 


46 


138 


Se cae. 


86 




155 


Hace calor. 


68 


139 


EstS lloviendo. 


52 




356 


Es un r Abano. 


76 


lUO 


Es una semana. 


57 




157 


Es el parque. 


78 


lUl 


Slrveme, mamA. 


62 




158 


Es mi amigo. 


85 


IU2 


Estas son semillas. 


61 




159 


Es perezoso. 


61 


1U3 


Es la una. 


90 




160 


Es el mantel. 


64 


lUU 


Coge la palita. 


38 




161 


Hoy es domingo. 


70 


1I+5 


Hola, hijos. 


86 




162 


£.Te gusta la lechuga? 


79 


1U6 


Hace frlo. 


96 




163 


Hace un dla bonito. 


53 


1U7 


Estos son pepinos. 


86 




164 


Bueno, chi cos. 


54 


1 U 8 


Ha llegado Pepe. 


50 




165 


Estas son unas 


81 












servilletas. 




1U9 


Son abrigos. 


80 


















166 


Tiene una zanahoria. 


71 


150 


Hay una pellcula. 


56 


















167 


Es la leche. 


84 


151 


Es hora de comer. 


6k 


















168 


Son helados. 


60 




JIM 
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Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


169 


Es un bcindido. 


67 


184 


Juega en el jardln. 


76 


170 


Son ^as papas. 


89 


185 


Es la televisiSn. 


98 


171 


Este es un 


90 


186 


Tiene ventanillas. 


38 




supermercado. 




187 


IPaco, corre! 


76 


172 


Me gusta el campo. 


kh 






173 


iQuSdense quietos, 
nifios ! 




188 


Siempre me gusta. 


34 


77 


189 


Es martes. 


73 




17^ 


Trae la canasta. 


60 


190 


Quiero volver. 


38 


175 


Hace sol. 


72 


191 


A la mesa, todos. 


74 


176 


Este es un auto. 


66 


192 


Puedo invitar a Pepe. 


29 


177 


Es el pan. 


86 


193 


Te agarro, Pepe. 


32 


178 


Son dos brazos. 


71* 


194 


SQue lilstima! 


63 


179 


Juguemos a la pega. 


66 


195 


Un momentito, papA. 


82 


180 


PapS estd echando una 


92 


196 


Me como las papas. 


64 




siesta. 










181 






197 


Sirvele a Maria 


47 


Es la primavera. 


kQ 




tambiAn. 


182 


Estas son salchichas. 


85 


198 


Es hora de comer. 


73 


183 


No saquen los brazos, 
niflos . 


53 


199 


Si Ant ate mAs cere a. 


4l 



- - J 
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TABLE llU Continued 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
pf Students 
Answering 
Correctly 


200 


EstA bien. 


70 


2l6 


Es el ndmero noventa. 


87 


201 


Hay doce meses en el 
afio. 


71 


217 


Se me olvidaron las 
ser^lletas . 


71* 


202 


Es cierto. 


la 


218 


iHace calor en julio? 


86 


203 


Coge la palita. 


la 


219 


Tenemos que volver. 


1*3 


20U 

205 


Es lunes. 

Paco, acSrcate. 


93 


220 


Es el nOmero 
cincuenta. 


8l 


53 








206 


Vamos en seguida. 


6o 


221 


Creo que si. 


1*6 


207 


Esta es la mostaza. 


70 


222 


Es jueves. 


82 


208 


Trae la palita, Pablo. 


57 


223 


cQui^n habla? 


51 


209 


Vamos al otro lado. 


69 


22k 


iPuedes ir? 


1*3 


210 


Livate las manos. 


75 


225 


Parece que ha llegado 
la primavera. 


59 


211 


Es el nOmero setenta. 


87 


226 


Pasamos por ti a las 


63 


212 


Crecen al sol. 


56 




dos. 




213 


Ya es bora. 


37 


227 


dHace frlo en junio? 


83 


2ll+ 


Es mi^rcoles. 


91 


228 


Dijame pedirle. 


1*2 


215 


No te sientes tan 
lejos. 


k6 


229 


dCuAntos son cinco 
por cinco? 


1*7 








230 


dEn quS mes estamos? 


57 
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Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 




Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


231 


Es viemes. 


86 




2kk 


EstA al otro lado. 


3k 


232 


ApCrate, Pepe. 


58 




2U5 


Voy a echar una 


65 












siesta. 




233 


Hay leche para Marla. 


70 


















2U6 


He da lo mismo. 


k6 


23U 


Entonces no hay postre 


6k 












para ti. 






2U7 


Es sAbado. 


93 


235 


iHace calor en enero? 


65 




2U8 


Hoy es lunes. 


80 


236 


iPxxedo invitar a un 


72 




2U9 


Hay que ir de 


U7 




amigo? 








compras . 




237 


iPara quS vamos • 


29 




250 


Tengo mucha haihbre. 


81 




mamacita? 




















251 


Es el nOmero cien. 


83 


238 


D^jame perdirle 


80 












permiso. 






252 


jlQuA dla es? 


7U 


239 


iPor que te comes las 


U8 




253 


EstA cerca de la 


35 




papas? 








pared. 




2U0 


Ellas estdn listas. 


60 




25U 


EstAn esperando en el 


58 












auto. 




2Ul 


Hace buen tiempo. 


63 


















255 


EstA satisfecho. 


79 


2U2 


iQuieres ver la 


73 












televisl8n? 






256 


iCrecen a la soihbra? 


68 


2U3 


iCuAntos son diez 


82 




257 


Ya comprciste las 


52 




menos cinco? 








salchichas . 
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TABLE llU Continued 

% 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


258 


Paremos aqul. 


U2 








259 


Es muy lent a. 


h 9 








260 


(LLas sembramos aqul, 
Marla? 


59 








261 


Es el nOmero cuarenta. 


8U 








262 


Vamos hace buen 

tiempo. 


65 








263 


Pon la mesa. 


78 








26U 


Ya va a terminar. 


U3 








265 


L^vate las manos antes 


73 










de comer. 










266 


Me gustan los helados. 


65 






♦ 


267 


P6nganse los abrigos. 


67 








268 


iTO haces las compras? 


6 k 








269 


!Qu^ aire tan fresco! 


6 k 








270 


&Qu§ quieres , mamacita'i 


86 
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PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH LISTENING 
COMPREHENSION GRAMMAR ITEM TESTED AT THE END OF THE MLA 
COURSE, WITH A DESCRIPTION OF EACH FEATURE TESTED* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


1 


Es Juan. 


Irregular form, verb ’*ser", 
3rd person singular, 
present tense 


Mvi(7) 


70 


2 


Te llama mamS. 


Noun phrase as direct 
object (pronoun) transi- 
tive verb, noun phrase as 
subject 


3aa( inv) 


U9 


3 


Pamela. 


Direct object pronoun, 3rd 
person, feminine singular 


Mp(5) 


85 




Quieren jugar en la sala. 


Noun phrase as subject (un- 
expressed), transitive verb 
with verb complement 


5f(u) 


80 


5 


£De quS color es la 
pizarra? 


Interrogative pattern (in- 
formation question): inter- 
rogative phrase, verb "ser” 
noun phrase as subject ex- 
pressed 


?(7) 


90 


6 


Es el niho. 


Noun phrase as subject (un- 
expressed) , verb "ser" noun 
phrase as predicate nomina- 
tive 


la(u) 


88 


7 


iTienes un perro? 


Interrogative signal (into- 
nation in yes-no question) 
with noun phrases as sub- 
ject unexpressed 


?(2) 


92 



* In items testing morphology, the feature tested is underlined. The items are listed 
in the order in which they were presented to students on the final test. The response 
alternatives were printed English sentences. 

^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
aJ.1 three courses. An explanation of the system is given in a note at the end of the 
table, p. 218 . 
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TABLE 115 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


8 


Es nd mufieca. 


Possessive adjective, 1st 
person singular, with sing- 
ular noun (masculine or 
feminine) 


Ma(6) 


80 


9 


Este es el cuarto de Paco. 


Use of "de” to show posses- 
sion 


NSP(l) 


58 


10 


iC6mo lo llamas? 


Regular form, "ar" verb, 
2nd person familiar singu- 
lar, present tense 


Mvr(2) 


66 


11 


Ve a buscar a Chispa. 


Imperative, irregular form, 
verb "ir", familiar singu- 
lar 


Mvi(l8) 


80 


12 


Son dos niflos. 


Irregular form, verb "ser", 
3rd person plural, present 
tense 


Mvi(9) 


58 


13 


Yo soy el sefior Martinez. 


Noun phrase as subject, 
verb "ser", noun phrase as 
predicate nominative 


la 


63 


ll* 


Mira mi mufieca nueva. 


Imperative, regular fonn, 
"ar" verb, 2nd person, 
familiar singular 


Mvr(l8) 


67 


15 


Tengo un libro. 


Irregular form, verb 


Mvr(l*) 


66 






"tener", 1st person singu- 
lar, present tense 




• 


16 


Yo me llamo Pedro. 


Noun phrase as subject, 
noun phrase as direct 
object (reflexive pronoun), 
transitive verb with noun 
phrase as compl ment 


5aa(r) 


53 


17 


Es un nifi£. 


Masculine singular noun, 
"o" ending 


Mn(l) 


77 


18 


iPale la tiza! 


Pronoun indirect object, 
3rd person singular, (mas- 
culine or feminine) 


Mp(6) 


23 



o 

ERIC 



212 






>V V :■ t o; J , _ . 







table 115 continued 



Number 

of 

Item 



Item 



19 Voy corriendo. 



20 dC6mo estSs , Paco? 



21 |ven acN. 



22 No tiene un gato. 



23 I El libro es verde. 



2h 



25 



26 



27 



IDile que venga ! 



iCdroo te llamas? 



Description of 
Feature Tested 



Code^ 



Noun phrase as subject (un-l 5hh(u) 
|Gxpz*G8SGd} 9 inti*€uisitiv6 
verb, present participle ofi 
verb I 

estar , 2nd person, fami- 
liar singuleur, present 
tense 

Imperative, Irregular form, I Mvi(l7) 
I verb venir , 2nd person 
familiar singular 

Negative pattern: noun I n( 6) 
phrase as subject (unex- 
pressed), negative parti- 
J®1®» "transitive verb, noun 
I phrase as direct object 

Noun phrase as subject, I ib 
verb "ser", predicate 
adjective 



Irregular subjunctive form, 
verb venir”, 3rd person 
singular 



Aqul estoy , 



Los nifios juegan a la pega. 



[Regular form, ”ar” verb 
with reflexive pronoun, 2nd 
person singular familiar, 
present tense 

Irregular form, verb 
estar , 1st person singu- 
lar, present tense 

Noun phrase as subject, 
transitive verb, relator 
word, noun phrase as direct 
object 



Mvi(23) 



Mvr(2) (r) 



Mvi(lO) 



3a 



Percentage 
of Students 
Answering 
Correctly 



69 



65 



91 * 



72 



96 



73 



71 



77 



to identicia features across 
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TABLE 11^ continued 



Number 

of 

Item 


It«n 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


28 


Voy a la pizarra. 


Irregular form, verb "ir", 
1st person singular, 
present tense 


Mvi(l) 


Ul 


29 


£Qu 8 tienes tCi? 


Interrogative pattern (in- 
formation question): inter- 
rogative word, transitive 
verb, noun phrase as subject 


?(5) 


55 


30 


Pepe, dile a Juanita que 
venga acS. 


Imperative, irregular form, 
verb "decir", 2nd person 
familiar singular 


Mvi(2U) 


80 


31 


iDSnde est& ^ hermana? 


Possessive adjective, 2nd 
person familiar singulen:, 
with singular noun (mascu- 
line or feminine) 


Ma(7) 


66 


32 


Dame la pelota. 


Pronoun indirect object, 

1st person singular (mascu- 
line or feminine) 


Mp(l) 


83 


33 


Me llamo Marla. 


Regular form, ”ar" verb 
with reflexive pronoun, 1st 
person singular, present 
tense 


Mvr(l) (r) 


90 


3U 


No, yo no tengo un perro. 


Recognition of negative 
signal preceding verb in a 
sentence following utter- 
ance "No" 


N(3) 


82 


35 


&Es pequefia la tiza? 


Interrogative pattern (yes- 
no question): verb "ser", 
predicate adjective, noun 
phrase as subject 


?(8) 


U9 


36 


Soy Paco. 


Irregular form, verb "ser", 
1st person singular, pres- 
ent tense 


Mvi(5) 


U6 


37 


Tenemos un gato. 


Regular form, verb "tener", 
1st person plural, present 
tense 


Mvr(8) 


U5 



er|c 
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TABLE 113 continued 



Nunber 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


38 


iCuindo pones la 
television^ 


Regular form, verb "poner”, 
2nd person familiar singu- 
lar, pre ent tense 


Mvr*(l2) 


39 


39 


£D8nde esti la mesa grande? 


Position of descriptive 
adjective following noun 


NSP(2) 


73 


40 


Se cae. 


Regular form, verb "caer", 
3rd person singular, 
present tense 


Mvr'(l6) 


50 


4l 


Se ve la escuela de la 
ventana. 


Reflexive pronoun "se" to 
indicate indefinite agent 


NSP(3) 


‘ 50 


42 


Td me pones la mesa. 


Noun phrase as subject, 
noun phrase as indirect 
object (pronoxm), transi- 
tive verb, noun phrase as 
direct object 


4aa 


30 


43 


Se cayd. 


Regular form, verb "caer", 
3rd person singular, pre- 
terite tense 


Mvr'dT) 


62 


44 


Se me olvidaron las 
servilletas . 


Noun phrase as direct 
object (reflexive pronoun), 
noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
subject 


4b(inv) 


73 


45 


Pon la mesa. 


Imperative, irregular form, 
verb "poner", 2nd person 
familiar singular 


Mvi(20) 


85 


46 


iEstd tu casa cerca de la 
escuela? 

( 


Interrogative pattern (yes- 
no question): intransitive 
verb, noun phrase as sub- 
ject, adverb 


?(10) 


71 



"f The coding system was designed as an aid in referring to identical featiures across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of the 
table, p. 218. 
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TABLE 115 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


U7 


He gustan. 


Regular form, "ar" verb, 
3rd person plurad, present 
tense 


Mvr(5) 


29 


U8 


Vamoe a verlas . 


Pronoun direct object, 3rd 
person feminine plural 


Mp(»*) 


U9 


U9 


tPdnganse los abrigos! 


InQ)erative, irregular form, 
verb "poner" with reflexive 
pronoun, 2nd person formal 
plural 


Mvi(2l) 


75 


50 


No crecen bien a la soihbra. 

/ 


Recognition of negative 
signal in initial position 
in utterance with noun 
phrase as subject ^ex- 
pressed 


N(2) 


71 


51 


Es para ti. 


Pronoun (after preposition) 
2nd person singular famil- 
iar (masculine or feminine) 


Mp(9) 


3U 


52 


Paco estd durmiendo. 


Irregular form, present 
participle, verb "dormir" 


Mvi(25) 


50 


53 


Tenemos que volver al otro 
lado. 


Noun phrase as subject 
(unexpressed) , transitive 
verb, relator word, infini- 
tive of verb 


5g(u) 


U9 


5U 


Crecen mejor al sol. 


Noun phrase as subject 
(unexpressed) , intransitive 
verb, luiverb 


2a(u) 


67 


55 


Hablamos con Paco. 


Regular form, "ar" verb, 
1st person plural, present 
tense 


Mvr(U) 


3U 


56 


Te vas a coiner tres 
pepinos . 


Noun phrase as subject 
(unexpressed) , noun phrase 
as indirect object (reflex- 
ive pronoun), intransitive 
verb, relator word, infini- 
tive of verb, noun phrase 
as direct object 


7b(u) 


65 
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TABLE 113 continued 



Nundser 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


57 


Hay qua ir de compras. 


Verb "hay", relator "que", 
infinitive of verb 


6c 


35 


58 


2QuC hacen? 


Regular form, verb "hacer", 
3rd person plural, present 
tense 


Mvr*(l0) 


la 


59 


Mami y Marla no estdn 
listas . 


Recognition of negative 
signal preceding verb in 
utterance with subject 
expressed 


N(l) 


80 


60 


iEsti arriba tu cuarto? 


Interrogative signal (into- 
nation in yes-no question) 
with noun phrase as subject 
expressed 


?(1) 


68 


6l 


Yo estoy sat isf echo. 


Noun phrase as subject, 
verb "estar", predicate 
adjective 


Id 


60 


62 


Ella lo puede agarrar. 


Noun phrase as subject, 
noun phraae as direct 
object (pronoun) , transi- 
tive verb with transitive 
verb as complement 


5ff 


27 


63 


Eres rouy lenta. 


Irregular form, verb "ser", 
2nd person singular famil- 
iar, present tense 


Mvi(6) 


53 


6h 


Hay lechuga en el jardln. 

1 j 


Verb "hay", noun phrase as 
subject, adverb 


6a 


68 


65 


Creo que si. ] 

\i 


Regular form, "er" verb, 

Lst person singular, pres— I 
snt tense 


Mvr(lU) 


73 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 

all three courses. An explanation of the system is given in a note at the end of the 
tahle, p.21o. 



o 



217 



TABLE 113 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


66 


Voy a buscar a Chispa. 


Noun phrase as subject (un- 
expressed) , intransitive 
verb, relator word, infini- 
tive of verb 


5h(u) 


72 


67 


Me gusta el campo. 


Noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
subject 


Uc(inv) 


67 


68 


Quiero verlo. 


Noun phrase as subject (un- 
expressed) , transitive verb 
with transitive verb as 
coiDplement, noun phrase as 
direct object (pronoun) 


5ff(u) 


69 


69 


EstS muy satisfecho. 


Regular form, verb ’’estar”, 
3rd person singular, 
present tense 


Mvi(l2) 


25 



NOTE TO TABLE 115 



CODING SYSTEM USED FOR LABELING FEATURE TESTED 
IN GRAMMAR AND GRAIMAR TRANSFER TESTS 



All items testing syntax begin with the numbers 1 through 7 or the 
symbols ?, N, I, and NSP. 

The numbers 1 through 6 represent six basic sentence patterns. The 
number 7 represents a pattern derived from basic sentence patterns. Small 
letters after the initial number represent a variation of that basic pat- 
tern. At the end of the code the following symbols may be present In 
parentheses: (u), meaning unexpressed subject; (Inv), meaning Inverted; 

(r), meaning reflexive, and (Ip), meaning Inperfectlve participle. 

Syntax items beginning with symbols other than munbers have the 
following meanings: 

7 ■ interrogative pattern 

N ■ negative pattern 

I « imperative pattern 

NSP « non sentence pattern 

Nixmbers In parentheses after these symbols indicate a subcategory. 

All Items testing morphology begin with a capital "M*'. Small letters 
following the capital "M” have the following meanings: 

n » noun 

vr * verb, regxilar form 

vr* *= verb, regular form, not all forms of verb regular 
vi * verb, irregular form 
a s adjective 
p ■ pronoun 

Numbers In parentheses at end of code indicate a subcategory. 
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TABLE 116 

PERCENTAGE OP STUDENTS CORRECTLY ANSWERING EACH LISTENING 
COMPREHENSION GRAMMAR TRANSFER ITEM TESTED AT THE END OP 
THE MLA COURSE, WITH A DESCRIPTION OP EACH FEATURE TESTED* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


1 


Mi casa es amarilla. 


Noun phrase as subject, 
verb "ser”, predicate 
adjective 


lb 


90 


2 


Son perros negros. 


Noun phrase as subject (un- 
expressed), verb "ser',* noxm 
phrase as predicate nomina- 
tive 


la(u) 


77 


3 


No, yo no como las papas. 


Recognition of negative 
signal preceding verb in 
utterance with subject ex- 
pressed (following the 
utterance "no") 


N(3) 


66 


k 


Lo busca Chispa. 


Noun phrase as direct 
object (pronoun), transi- 
tive verb, noim phrase as 
subject 


3aa( inv) 


7 


5 


iQuiere $1 otra pelota? 


Interrogative signal (into- 
nation in yes-no question) 
with noun phrase as subject 
expressed 


?(1) 


55 


6 


No escriben la lecci6n. 


Negative pattern: noun 
phrase as subject (unex- 
pressed) , negative particle 
transitive verb, noun 
phrase as direct object 


N(6) 


1^5 



* The items are listed in the order in which they were presented to students on the 
final test* The response alternatives were printed English sentences. 

^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115, 
P* 218. 
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TABLE 116 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


7 


iEs bianco tu perro? 


Interrogative pattern (yes- 
no question) : verb "ser" , 
predicate adjective* noun 
phrase as subject 


?(8) 


5U 


8 


Usted se llama Paco. 


Noun phrase as subject, 
noun phrase as direct 
object (reflexive pronoun), 
transitive verb with noun 
phrase as complement 


5aa(r) 


51 


9 


TO invitas a la nifia. 


Noun phrase as subject, 
transitive verb, relator 
word, noun phrase as direct 
object 


3a 


U7 


10 


iDe quiOn es esta casa? 


Interrogative pattern (in- 
formation question): inter- 
rogative phrase, verb "ser" 
noun phrase as subject 


?(7) 


Ul 


11 


iQud dibuja dl? 


Interrogative pattern (in- 
formation question) : inter- 
rogative word, transitive 
verb, noun phrase as sub- 
ject 


?(5) 


38 


12 


Tengo la pistola de Paco. 


Use of "de" to show posses- 
sion 


NSP(l) 


33 


13 


Va jugauido. 


Noun phrase as subject (Tin- 
expressed) , intransitive 
verb, present participle of 
verb 


5hh(u) 


U3 


lU 


Pueden pintar mi cuarto. 


Noun phrase as subject (un- 
expressed), transitive verb 
with transitive verb comp- 
lement, noun phrase as 
direct object 


5f(u) 


62 


15 


Elios son profesores. 


Noun phrase as subject, 
verb "ser", noun phraise sis 
predicate nominative 


la 


35 



TABLE 116 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


16 


Le gustan los perros. 


Noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
subject 


Uc(inv) 


60 


17 


2C6mo estd tu hermana 
bonita? 


Interrogative pattern (in- 
formation question): inter- 
rogative word, intransitive 
verb, noun phrase as 
subject (modified) 


?(6) 


UO 


18 


Hay que buscar a mi 
hermana. 


Verb "hay", relator "que", 
infinitive of verb 


6c 


27 


19 


Puedes jugarlo. 


Noun phrase as subject (un- 
expressed), transitive verb 
with transitive verb con^)- 
lement, noun phrase as 
direct object (pronoun) 


5ff(u) 


51 


20 


No duerme bien. 


Recognition of negative 
signal in initial position 
in utterance with noun 
phrase as subject unex- 
pressed 


N(2) 


55 


21 


Se va a comprar dos 
abrigos . 


Noun phrase as subject (un- 
expressed) , noun phrase as 
indirect object (reflexive 
pronoun), intransitive verb 
relator word, noun phrase 
as direct object 


7b(u) 


ko 


22 


Tengo que escribir en la 
sizarra. 


Noun phrase as subject (un- 
expressed), transitive verb, 
relator word, infinitive of 
verb 


5g(u) 


52 


23 


»aco y papS no estSn 
listos. 


Recognition of negative 
signal preceding verb with 
subject expressed 


N(l) 


77 



7^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115, 
P. 218. 
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TABLE 116 continued 



Number 

of 

Item 



2k 



29 



30 



Item 



Se le cay6 la pis tola. 



25 iTiene una pistola? 



26 INosotros lo podemos ver. 



Ouerme un poco. 



Se compran los abrigos en 
la tienda. 

Vamos a tomar la leche. 



Hay un perro en la casa. 



iEstNn los libros en tu 
cuarto? 



IYo me como las salchichas. 



Description of 

Feature Tested Code 



Noun phrase as direct i*b(inv) 

object (reflexive pronoun), 

Inoun phrase as indirect 
object (pronoun), transi- 
jtive verb, noun phrase as 
subject 

Interrogative signal (into- ?(2) 
nation in yes-no question) 
with noun phrase as subject 
unexpressed 

Noun phrase as subject, 5ff 
Inoun phrase as direct 
object (pronoun), transi- 
tive verb with transitive 
verb as coiiq)lement 

Verb "hay", noun phrase as 
subject, adverb 

Interrogative pattern (yes- 
Ino question) : Intransitive 
verb, noun phrase as 
subject, adverb 

Noun phrase as subject, | Uaa 
Inoun phrase as indirect 
lobject (pronoun) , transi— 

I'tive verb, noun phrase as 
Idlrect object 

iNoun phrase as subject (un- I 2a(u) 
lexpressed) , intransitive 
jverb, adverb 

iReflexive pronoun "se" to 
lindicate indefinite agent 

Noun phrase as subject ( un- 
expressed) , intransitive 
verb, relator word, infini- 
tive of verb 



Percentage 
of Students 
Answering 
Correctly 



55 



79 



25 



ho 



k3 



r 



w'U.m P.ipufi 



1 ,111 -1 1 1 
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TABLE 116 continued 



Nuniber 

of 

Item 


Item 


Description of 
Feature Tested 


Code^* 


Percentage' 
of Students 
Answering 
Correctly 


33 


Paco y yo estamos 
escribiendo en la pizarra. 


Noun phrase as subject* in- 
transitive verb (estar + 
present participle)* adverb 


2 a(lp) 


66 


3 U 


Las papas frlas estSn 
listas. 

• 


No\m phrase as subject* 
verb "estar”* predicate 
adjective 


Id 


58 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An esqplanation of the system is given in a note at the end of Table 11 ^, 
P» 218. 
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TABLE 117 



PERCEMTAGE OP STUDENTS CORRECTLY ANSWERING iJACH SPEAKING VOCABULARY 
ITEM TESTED AT END OP COURSE IN MLA CLASSES, SHOWING 
THE CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 
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TABLE 117 Continued 















Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


65 


Ndmero quince. 


63 

28 


81 


iCudndo viene 
Marla? 


3 


66 


Borra la pizarra. 


82 


iQuA tal, Paco? 










3 


67 


Soy Carlos. 


13 


83 


Escribe en la 


36 


68 


quieres 
( quiere ) ? 


0 




pizarra. 


• 

26 






8U 


Ven acd (aqul). 


69 


Dile a Paco. 


6 

86 


85 


Ntimero dos. 


90 


70 


Ndmero ocho. 


86 


Tenemos un gato. 


5 




71 


El estd cerrando 
la puerta (cierra). 


20 


87 


De quiS color es. 


28 


72 


£QuA estd haciendp 


1 


88 


Estd ahl enf rente. 


11 




(hace)? 




89 


Abre la puerta. 


23 


73 


&D6nde estA? 


l6 






. Qk 








90 


Ndmero diez. 


Ih 


Cuenta de uno a 


6 




Dibuja la casa. 






cinco. 




91 


5 


75 


Ndmero tres. 


95 


92 


Vamos . 


18 


76 


^C6mo te llamas 


23 


93 


Cierra la puerta. 


29 




(C6mo se llamas? 




9k 


Mamd estd llamando 


3 


77 


Rebota la pelota. 


Ik 




(llama) a Paco. 




78 


Plntala amarilla. 


1 


95 


Ndmero siete. 


91 


79 


Hasta luego. 


28 


96 


Miren (mire) el 


23 








libro. 




80 


Ndmero doce. 

L 


81 


97 


Quiero verlo. 


5 



TABLE 117 Continued 















Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


98 


Buenos dlas. 


U6 


116 


Dos ^ dos son 


70 










cuatro . 




99 


Me llamo Pedro. 


59 


117 


Hola, nifios. 


U 5 








100 


Ndmero uno. 


93 


118 


Ndmero cinco. 


90 


101 


Tres veces. 


6 


119 


Pap^ viene. 


0 


102 


iCudntos tiene 
(tienes^? 


1 


120 


Ahora, vamos. 


1 


103 


Estoy aqul 


3 


121 


Con Marla. 


0 




(or inverted). 




122 


Por favor. 


28 


lOU 


£1 estS fuera. 


18 


123 


En el cuarto. 


25 


105 


Ndmero nueve . 


83 












12U 


De nada. 


53 


106 


PrSstame el libro. 


1 




Est^ ahl. 










125 


1 


lOT 


Pues, vamos. 


0 


126 


Bien, gracias, y 


uo 


108 


Buenos dlas, nifios 


56 




usted (tfi)? 






(muchachos). 




127 


£1 gato es regular. 


uo 


109 


Gracias . 


71 


128 


Bueno, Paco. 


0 


110 


Ndmero trece. 


75 


129 


EstS arriba. 


36 


111 


Este es el libro. 


18 


130 


Mamd viene pronto. 


6 


112 


Hasta mabana. 


20 


131 


Carlos 0 Marla. 


31 


113 


iQuiSn es el 
muchacho? 


1 


132 


Es un picnic. 


70 


llU 


IClaro! 


8 


133 


Es una semana. 


1 


115 


Bien, gracias. 


28 


13U 


Es una palita. 


18 
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TABLE 117 Continued 

















Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


135 


£s una mano. 


U6 




I5U 


Es la primavera. 


23 


136 


Es un telSfono. 


U6 




155 


Es bonito. 


lU 


137 


Es un rAbano. 


26 




156 


Es came. 


UO 


138 


Es un parque. 


68 




157 


Es lunes. 


50 


139 


Es una zanahoria. 


29 




158 


Es (verdad) 
cierto. 


0 


lUO 


Es un auto. 


U8 




159 


Es la una. 


29 


lUl 


Es una salchicha. 


Ul 




160 


Es la mostaza. 


26 


lU2 


Es un jardin. 


58 




161 


Es el mantel. 


11 


lU3 


Es un afio. 


6 




162 


Es el 


66 


Ikk 


Es un mes. 


3 






supermercado. 




1U5 


Es un bandido. 


20 




163 


Es el campo. 


13 


1U6 


Es una canasta. 


8 




16U 


Es la 

televisidn. 


88 


lUT 


Es un abrigo. 


16 




165 


Es el canal 


U5 


lU8 


Es un amigo. 


20 






tres. 




1U9 


Es mi hijo. 


0 




166 


Es la pelicula. 


8 


150 


Es leche. 


56 




167 


Son servilletas. 


25 


151 


Es lechuga. 


56 




168 


Son pepinos. 


lU 


152 


Son helados. 


25 




169 


Son semillas. 


lU 


153 


Es pan. 


56 




170 


Son papas. 


UO 



TABLE 117 Continued 









1 


\ - 


Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


171 


Es martes. 






189 


Es domingo. 


51 


172 


Es perezoso. 


ih 




190 


6QuiSn habla 
(estS hablando)? 


3 


173 


Es lento. 


8 




191 


6Puedes ir? 


0 


17U 


EstSi cerca. 


0 
















192 


Ndmero cuarenta. 


4l 


175 


iMira c6mo salta! 


8 




193 


Paco, acSrcate. 


10 


176 


Ndmero noventa. 


Uo 




19i+ 


Yo agarro a 


0 


177 


Pepe ha llegado. 


0 






Pepe. 




178 


Es miSrcoles. 


50 




195 


Miguelito se 


35 












cae. 




179 


Quiero una siesta. 


21 




196 


Es jueves. 


31 


180 


Quiero volver. 


0 




197 


Como papas. 


13 


l8l 


Coge el libro. 


0 




198 


Sirveme . 


l4 


l82 


Hace sol. 


5 




199 


Qu^dense quietos, 


0 


183 


L^vate las manos. 


20 






nihos . 




l8U 


Es julio. 


38 




200 


Corre, Paco. 


16 


185 


Crecen al sol. 


1 




201 


Tengo dos 
brazos . 


l4 


186 


Trae el libro. 


0 




202 


Juego a la 


3 


187 


Se me olvidaron 
los libros. 


13 






£ega. 












203 


Parece la 


0 


188 


Tenemos que volver. 


1 






primavera. 












204 


Es junio. 


29 



i o 

ERIC 
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TABLE 117 Continued 

















Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 




Correctly 








Correctly 


236 


Hace calor. 


16 




252 


Dos por dos es 
cuatro. 


8 


237 


Hay postre. 


13 




253 


Hay leche para 


1 


238 


Nfimero cien 
(ciento). 


U6 




25k 


Marla. 


20 








Ntmero setenta. 


239 


T(i vas de compras. 


5 




255 


Crecen a la 


3 


2U0 


Un momentito 


16 






sombra. 






(momento), Paco. 






256 


Dos menos uno es 


U6 


2U1 


Siempre hace 


0 






uno. 






frlo. 






257 


Vamos £1 hace 


3 


2U2 


!Qu§ iSstima! 


13 






buen tiempo. 




2U3 


Estd bien. 


5 




258 


Es aire fresco. 


6 


2kk 


EstS al otro lado. 


1 




259 


Vamos al otro 
lado. 


6 


2U5 


Buenos dlas, 
mamacita. 


71 




260 


LSvate las manos 
antes de comer. 


11 


*i*»W 


Tengo mucha 
hcimbre . 


29 




261 


Vamos, todos. 


3 


2U7 


Me da lo mismo. 


0 




262 


Tengo un gato, 
tambiSn. 


1 


2U8 


Vamos en seguida. 


0 




263 


Hay que (es 


3 


2U9 


iPor quS? 


3 






necesario). 




250 


EstS listo. 


3 




26k 


Hoy es lunes. 


lU 


251 


cEstS lejos? 


5 











o 
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TABLE 118 



PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH SPEAKING GRAMMAR 
ITEM TESTED AT THE END OP THE MLA COURSE, SHOWING RESULTS OP 
SCORING ON DISCRETE ELEMENTS AND ON ENTIRE UTTERANCE*- 



Number 




Description of 




Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Codef 


Discrete 

Element 


Entire 

Utterance 


1 


Paco es un nifio. 


Noun phrase as subject, 
verb "ser”, noun phrase as 
predicate nominative 


la 


75 


28 


2 


Es la una. 


Definite article plus 
number in reference to 
telling time 


NSP(U) 


55 


38 


3 


Paco tiene un libro. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


23 


Ik 


U 


Me gust a el campo. 


Noun phrase as indirect 
object (pronoun), transi- 
tive verb, noxm phrase as 
subject 


Uc(inv) 


31 


6 


5 


Estoy satisfecho. 


Noun phrase as subject, 
verb "estar”, predicate 
adjective 


Id 


28 


Ik 


6 


(Si.) Si^ntate, Paco. 


Affirmative imperative pat- 
tern: transitive verb plus 
noun phrase as direct 
object (pronoun) 


1(1) 


28 


l6 



* Items are listed in the order in which they were presented to students on the final 
test. In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to be completely free of error 
for the response to be marked correct. A complete listing of the elements re<iuired in each 
student response is presented in Table 119 p. 239. 

The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115, 

p. 218 . 
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TABLE 116 continued 



Number 

of 

Item 




Description of 
Feature Tested 




Percentage of Students 
Answering Correctly 


Item 


Code 


Discrete 

Element 


Entire 

Utterance 


7 


Marla esti cerrando 
la puerta. 


Noun phrase as subject, 
transitive verb ("estar" + 
present participle), noun 
phrase as direct object 


3a(Ip) 


1 


0 


8 


Tengo el bianco. 


Definite article preceding 
nominalized descriptive 
adjective 


NSP(5) 


8 


0 


9 


iTii me pones la mesa? 


Noun phrase as subject, 
noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
direct object 


Uaa 


5 


3 


10 


(SiO Marla te llama. 


Noun phrase as subject, 
noun phrase as direct 
object (pronoun), transi- 
tive verb 


3aa 


13 


6 


11 


Tenemos que volver. 


Noun phrase as subject (un- 
expressed), transitive verb , 
relator word, infinitive of 
verb 


5g 


11 


8 


12 


Marla estA arriba. 


Noun phrase as subject, 
verb "estar", adverb 


le 


13 


13 


13 


Marla lo puede 
agarrar. 


Noun phrase as subject, 
noun phrase as direct 
object (pronoun), transi- 
tive verb with transitive 
verb complement 


5ff 


6 


1 


lU 


El iSpiz es verde. 


Noun phrase as subject, 
verb "ser", predicate 
adjective 


lb 


U6 


29 


15 


Se me olvidaron las 
servilletas . 


Noun phrase as direct 
object (reflexive pronoun), 
noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
subject 


4b( inv) 


11 


10 



o 
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TABLE 118 continued 



Number 




Description of 
Feature Tested 




Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Code^ 


Discrete 

Element 


Entire 

Utterance 


16 


Voy a buscar a Chispa. 


Noun phrase as subject (un- 
expressed) , intransitive 
verb, relator word, infini- 
tive of verb 


5h 


lU 


6 


17 


Hay lechuga en el 
jardln. 


Verb "hay", noun phrase as 
subject, adverb 


6a 


1 


0 


18 


Hay que ip de compras. 


Verb "hay", relator "que", 
infinitive of verb 


6c 


6 


3 


19 


Los nifios quieren 
jugar. 


Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 


5f 


5 


3 


20 


Me llamo Paco. 


Noun phrase as subject, 
noun phrase as direct 
object (reflexive pronoun), 
transitive verb with noun 
phrase as conqplement 


5aa(r) 


65 


58 


21 


iTiene Maria un libro 
azul? 


Position of descriptive 
adjective following noun 


NSP(2) 


20 


0 


22 


No, es el cuaz*to de 
Paco. 


Use of "de" to indicate 
possession 


NSP(l) 


6 


3 


23 


No, Paco no quiere 
una Coca-Cola. 


Negative pattern: noun 
phrase as subject, nega- 
tive particle, transitive 
verb, norm phrase as 
direct object (in sentence 
following the utterance 
"No") 


N(ll) 


3 


1 

\ 



i‘ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table II5, 

p. 218. 
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TABLE 118 continued 



Number 

of 

Item 


Item 


Description of 




Percentage of Students 
Answering Correctly 


Feature Tested 


Code 


Discrete 

Element 


Entire 

Utterance 


2 k 


Paco, dAmelo. 


Affirmative imperative pat- 
tern: transitive verb plus 
noun phrase as indirect 
object (pronoun) and noun 
phrase as direct object 
(pronoun) 


1(2) 


3 


1 


25 


No, Marla, no te 
sientes. 


Negative imperative pattern: 
"no" plus noun phrase as 
direct object (pronoun) 
transitive verb 


1(3) 


0 


0 


26 


iEstd lista Marla? 


Interrogative pattern (yes- 
no question): "estar", ad- 
verb, noun phrase as 
subject 


?(ll^) 


20 


5 


27 


iTiene Paco un gato? 


Interrogative pattern (yes- 
no question) : transitive 
verb, noun phrase as sub- 
ject, noun phrase as direct 
object 


?(U) 


8 


5 


26 


iDdnde estS tu cuarto? 


Interrogative pattern (in- 
formation question): inter- 
rogative word, intransitive 
verb, noun phrase as 
subject 


?(6) 


26 


0 


29 


iEs grande tu gato? 


Interrogative pattern (yes- 
no question): verb "ser", 
predicate adjective, noun 
phrase as subject 


?(8) 


5 


0 


30 


cQue tiene Paco? 

t 

1 


interrogative pattern (in- 
formation question): inter- 
rogative word, transitive 
verb, noun phrase as 
subject 


?(5) 


5 


1 
















1 
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TABLE 118 continued 



Number 

of 

Item 


Item/ 


Description of 


i 


Percentage of Students 
Answering Correctly 


Featiare Tested 


Code/- 


Discrete 

Element 


Entire 

Utterance 


31 


(SI.) Tengo un nerro. 


Irregular form, verb 
"tener" first person singu- 
lar, present tense 


Mvi(4) 


23 


18 


32 


No, (son) los nifiO£. 


Agreement of plural article 
+ plural noun 


Mn(3) 


6 


3 


33 


(SI.) Es mi libro. 


Possessive adjective, first 
person singular with singu- 
lar noun (masculine or 
feminine ) 


Ma(6) 


20 


11 


3 k 


(SI.) Eres lento. 


Irregular form, verb "ser", 
second person singular 
familiar, present tense 


Mvi(6) 


1 


0 


35 


(SI.) Hay postr^ para 
ti. 


Second person singular 
familiar, pronoun object 
of preposition 


Mp(9) 


8 


5 


36 


(Marla,) mira el libro. 


•'amlliar command, regular 
form, "ar" verb 


Mvr(l8) 


11 


3 


37 


Yo agarro a Paco. 


tegular form, "ar" verb, 
first person singular, 
present tense 


Mvr(l) 


16 


3 


38 


'[Paco,) yen acA. 


■'amiliar command, irregular 
form, verb "venir" 


Mvi(l7) 


25 


16 


39 


Paco) estS cerrando 
la puerta. 


Regular form verb "cerrar", 
present participle 


Mvr'(l5) 


10 


1 


Uo 


[No. ) Es ^ nifi£. i 

i 

1 


l^reement feminine singular 
urticle * feminine singular 
loun 


Mn(2) 


29 


25 



^ Items 31-60 test morphology. In each item the specific feature tested is underlined. 

i The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115 
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TABLE 118 continued 



Number 


Item 


Description of 




Percentage of Students 
Answering Correctly 


01 

Item 


Feature Tested 


Code 


Discrete 

Elements 


Entire 

Utterance 


Ul 


(El iSpiz) es amarillo. 


Agreement masculine singu- 
lar noun (+ verb ser) + 
meusculine singular euljec- 
tive 


Mad) 


U8 


18 


k2 


(SI.) Es tu hermana. 


Possessive adjective, 
second person singuleu* with 
singular noun (masculine or 
feminine ) 


Ma(7) 


5 


5 


U3 


Tengo dos libro£ 
verdes . 


Agreement meusculine plural 
noun + adjective with "es" 
ending 


Ma(5) 


3 


1 


kk 


(No.) Las nifias estSn 
listas. 


Agreement feminine plureJ. 
noun (+ verb "esteur") + 
feminine plural adjective 


Ma(U) 


1 


0 


U5 


(Si.) Tenemos libros. 


Regular form, verb "tener", 
first person pluretL, 
present tense 


Mvr(8) 


1 


1 


U6 


|[SI.) Te llamas Paco. 


Regular form, "ax" verb, 
second person singular, 
present tense 


Mvr(2) 


3 


1 


U7 


i[Sl.) V£ a la puerta. 


Irregular form, verb "ir", 
familiar command 


Mvi(l8) 


3 


3 


U8 


[No.) Marla agarra a 
Paco. 


Regular form, "ar" verb, 
third person singular, 
present tense 


Mvr(3) 


31 


20 


k9 


[Si.) Dame la tiza. 


First person singular. 
Indirect object pronoun 
(masculine or feminine) 


Mp(l) 


6 


5 


50 

< 


(No.) Marla estS 
arriba. 1 

] 


Irregular form, verb "estar" 
third person singular, 
present tense 


Mvi(12) 


28 


20 


51 

( 


[No.) (Miguelito) se ] 

ca5ro. j 

] 


Regular form, verb "caer", 
preterite tense, third 
person singular 


Mvr’(17) 


UO 


36 
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TABLE 118 continued 



Number 


Itam^ 


Description of 


Code^ 


Percentage of Students 
Answering Correctly 


of 

Item 


FSatura Tasted 


Discrete 

Element 


Entire 

Utterance 


52 


(Nifioa*) miran al 
libro. 


Plural command* regular 
form, "ar" verb 


Mvr(19) 


5 


1 


53 


(Paco») pon la tala- 
vis i6n. 


Familiar comaand, irregular 
form, verb "poner" 


Mvi(20) 


18 


18 


5U 


(L£ palota) as roja. 


Agreement feminine singular 
noun (+ verb "ser") + 
feminine singular adjective 


Ma(3) 


lU 


6 


55 


(Nifios.) pdnganaa loa 
abrigos . 


Plural command, irregular 
form, verb "poner" with 
reflexive pronoun 


Mvi(2l) 


5 


3 


56 


(Si.) Voy al parqua. 


Irregular form, verb "ir", 
first person singular 


Mvi(l) 


5 


0 


57 


(Pacot) silntata. 


Familiar command, irregular 
form, verb "sentar" 


Mvi(22) 


k 3 


38 


58 


(Si.) Quiaro verlas . 


Third person feminine 
plural direct object 
pronoun 


Mp(U) 


0 


0 


59 


(Si.) Dale la palota. 


Third person singular (mas- 
culine or feminine) 
indirect object pronoun 


Mp(6) 


36 


20 


60 


No» trdala td> (Paco.) 


Third person feminine sing- 
ular direct object pronoim 


Mp(5) 


10 


6 



/ Items 31*60 test morphology. In each item the specific feature tested is imderlined. 

^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table II5, 

p. 218. 
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TABLE 119 continued 



2U0 




* Proper nay appear at end of aentence instead of beginning . 
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Proper name may occur at end of sentence instead of slot 1. 

Lo (object pronoun) must occur in slot 2 or slot but not in both slots 
Only infinitive is acceptable. 
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Only infinitive is acceptable. 
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TABLE 119 continued 
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TABLE 120 



PERCEKTAGE CT STUDENTS CORRECTLY ANSWERING EACH SPEAKING GRAMMAR 
transfer item TESTED AT THE END OP THE MLA COURSE, SHOWING 
RESULTS OP SCORING ON DISCRETE ELEMENTS AND ON ENTIRE UTTERANCE* 



Number 




Description of 


j 


Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Code^ 


Discrete 

Element 


Entire 

Utterance 


1 


Paco es un vaquero. 


Noun phrase as subject, 
verb "ser", noun phrase as 
predicate nominative 


la 


U3 


10 


2 


La nifia tiene tres 
gatos . 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


20 


lU 


3 


Yo estoy abriendo la 
vent ana. 


Noun phrase as subject, 
transitive verb (estex + 
present participle), noun 
phrase as direct object 


3a(IP) 


5 


1 


U 


La tiza es verde. 


Noun phrase as subject, 
verb "ser", predicate 
adjective 


lb 


68 


58 


5 


Si, me gusta el parque. 


Noun phrase as indirect 
object (pronoun), transi- 
tive verb, noun phrase as 
subject 


Uc(inv) 


13 


6 


6 


No, Paco estA 
satisfecho. 


Noun phrase as subject, 
verb "estar", predicate 
adjective 


Id 


3 


3 


7 


Marla estA fuera. 


Noun phrase as subject, 
verb "estar", adverb 


le 


3 


3 



* Items axe listed in the order in which they were presented to students on the final 
test. In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to be completely free of error 
for the response to be marked correct. A con 5 >lete listing of the elements required in each 
student response is presented in Table 121 , p. 252. 

/ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115, 

p. 218 . 
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TABLE 120 continued 



Number 


Item 


Description of 




Percentage of Students 
Answering Correctly 


of 

Item 


Feature Tested 


Code 


Discrete 

Element 


Entire 

Utterance 


8 


Si, y te llama. 


Noun phrase as subject, 
noun phrase as direct 
object (pronoun) , transi- 
tive verb 


3aa 


3 


1 


9 


Si, te llamas Paco. 


Noun phrase as subject, 
noun phrase as direct 
object (reflexive pronoun); 
transitive verb with noun 
phrase as complement 


3aa(R) 


11 


3 


10 


&T(i me pones la mesa? 


Noun phrase as subject, 
pronoun as indirect object, 
transitive verb, noun 
phrase as direct object 


Uaa 


0 


0 


11 


No, tienen que comer. 


Noun phrase as subject (un- 
expressed) intransitive 
verb, relator word, infini- 
tive of verb 


5g 


0 


0 


12 


Yo lo puedo agarrar. 


Noun phrase as subject, 
noun phrase as direct 
object (pronoun) , transi- 
tive verb with verb comple- 
ment 


5ff 


0 


0 


13 


No, quiero comer. 


Noun phrase as subject, 
transitive verb requiring 
complement, infinitive of 
verb 


5f 


0 


0 


Ik 


Paco, d&nela. 


Affirmative imperative pat- 
tern; transitive verb plus 
noun phrase as indirect 
object (pronoxm) and noun 
phrase as direct object 
(pronoun) 


1(2) 


8 


5 


15 


iAy! Se me olvidaron 
las salchichas. 


Noun phrase as direct 
object (reflexive pronoun), 
noun phrase as indirect 
object (pronoun), transi- 
tive verb, noTUi phrase as 
subject 


Ub(inv) 


10 


6 



TABLE 120 continued 






/ 



Number 




Description of 




Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Ctode^ 


Discrete 

Element 


Entire 

Utterance 


16 


No, vamos a jugar. 


Noun phrase as subject (un- 
expressed). Intransitive 
verb, relator word, infini- 
tive of verb 


5h 


5 


3 


17 


Tango la roja. 


Definite article preceding 
nominalized descriptive 
adjective 


NSP(5) 


6 


1 


18 


No, Paco no esti en 
casa. 


Negative pattern: noun 
phrase as subject, negative 
particle, intransitive verb, 
adverb (in sentence follow- 
ing the utterance "no”) 


N(ll) 


1 


1 


19 


iVa Marla al picnic 
hoy? 


Interrogative pattern (yes- 
no), Intransitive verb, 
noun phrase as subject, 
adverb 


T(10) 


1 


0 


20 


Hay un Idpiz en la 
mesa. 


Verb "hay", noun phrase as 
subject, adverb 


6a 


3 


1 


21 


iDdnde estin las 
salchichas? 


Interrogative pattern (in- 
formation question): inter- 
rogative word, intransitive 
verb, noun phrase as 
subject 


T(6) 


13 


0 


22 


iTiene Paco un perro 
tanibiSn? 


Interrogative pattern (yes- 

no question): transitive 

verb, noun phrase as 

subject, noun phrase as dir- 
ect object 


T(U) 


1 


0 


23 


Hay que buscar a 
Chispa. 


Verb "hay", relator "que", 
infinitive of verb 


6c 


0 


0 



^ The coding system vas designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115. 

p. 218. ’ 
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TABLE 120 continued 



Niuniber 

of 

Item 



Item 



Description of 
Feature Tested 



Code 



Percentage of Students 
Answering Correctly 



Discrete 

Element 



Entire 

Utterance 



2h 



25 



No, es el libro de 
Marla. 

£Es roja la tiza? 



Use of "de" to indicate 
possession 

Interrogative pattern (yes- 
no question): verb "aer", 
predicate adjective, noun 
phrase as subject 



NSP(l) 

?( 8 ) 



1 

6 



26 



Paco tiene un perro 
grande . 



27 



Si, Paco, levintate. 



28 



Son las tree. 



Position of descriptive NSP(2) 
adjective following noun 

Affirmative imperative pat- 1(1) 
tern: transitive verb plus 
noim phrase as direct 
object (pronoun) 



Definite article plus 
number in reference to 
telling time 



NSP(U) 



29 



Marla, no te levantes. 



Negative imperative pat- 
tern: "no" plus noun phrase 
as direct object (pronoun), 
transitive verb 



1(3) 



30 



&Qu6 quiere Paco? 



Interrogative pattern (in- 
formation question ) : inter- 
rogative word, transitive 
verb, noun phrase as 
subject 



?(5) 



33 

25 



20 



0 



3 



1 

25 



11 



0 



1 
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TABLE 121 continued 




• The eoabination ae neap is incorrect 



TABLE 121 continued 
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Lo (object pronoun) must occur in slot 2 or 5, but not in both. 

Onij the infinitire is acceptable. 

Proper nane may appear at end of sentence instead of at the beginning. 
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Proper name may appear at end of sentence instead of in slot 2. 



TABLE 121 continued 




Pr<^r naae may appear at end of sentence instead of at the beginning. 



259 



CM 

CM 

H 

a 

i 




CO 





* The features of phonology are listed in the order in which they were presented to students on the finaO. test. 
The required student response was always a brief Spanish utterance. Only the specific feature listed was e^valuated. 
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APPENDIX B 

SPA COURSE OBJECTIVES AND 
STUDENT PERFORMANCE DATA 













Ob.iectlves from Published Course 

The statement presented below is an excerpt from the SPA teacher's manual.^ 

Here, briefly, is a description of the kinds of performance the student can 
be expected to produce when he has completed Spanish A. 

In the realm of phonology, he will respond to Spanish, spoken at natural rates 
of speed, with his own utterances that range in phonetic quality from good to near- 
native. This includes appropriate intonation, s inale fa and Spanish syllable 
Junctxure. He will be able to read aloud with little or no degradation of his 
aural-oral level of accuracy, and he will be able to write down what he hears at 
approximately the same level of accuracy as a Spanish child in the first or second 
grade. What mistakes he makes will be native-like errors — an occasional omission 
of h, a phrase written as one word, occasional inaccinracy in the use of accent 
marks, etc. 



In the general range of morphology and syntax, he will demonstrate an extreme- 
ly high level of accuracy in number-gender agreements (generally from 90 % and up), 
both in tezms of noun-adJective-pronoun as well as subject-verb-predlcate. For 
exasqple, no girl student is ever likely to say "Soy alto," nor is any student 
likely to say "Mis hermanos son alto." 

The range of structures handled by the student includes: 

1) basic patterns of affirmation, negation, interrogation (including 
&D6nde? , ^Cuinco? , jQuifa? , etc.) 

2) the morphology of the verb in the present tense (the most common 
"irregular" verbs, including radical changing verbs, are intensively drilled) 

3) dependent infinitival constructions with querer , poder . and tener 

U) the morphology and syntax of the subject and diz^ect object pronouns 
( including such patterns as "El que toca la guitarra es mi hermano . " ) 

5 ) patterns of the comparative involving mAs and menos . etc. 

The issue of "vocabulary" is a tender one, since there is no real agreement 
on how to count lexical items. To count the infinitive of a verb as one item is 
misleading, if the inclusion of the infinitive implies that the student commands 
all the possible paradigmatic forms, including the use of the infinitive as a noun. 
Shall we count hermano-hermana as one item? If so, why not hombre-mujert If 
tiene is listed once, what does it mean in these three sentences: 

1. Tiene muchos amigos . 

2. Tiene suefio . 

3* Tiene que salir. 



^ Material in this section is quoted from A Programned tourse in Spanish. 
Teacher's Manual. Sapon, S.M. (Encyclopedia Brltannlca Films, INC., 19i5l). By 
permission of the publisher. 
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If "counting" is insisted upon* the writer is incline^’ tc believe that dis- 
tinguishable semantic differences be considered rather than raw lexical material. 
In this light, it can be said that after Spanish A the student controls a vocabu- 
lary approaching ^00 items. 

It is important to note that the selection of the vocabulary was made on the 
basis of three criteria: 

1) the phonetic usefulners and appropriateness in the development of 
oral skill 

2) the potential "productiveness" of the item in terms of its future 
role in developing the morphology and syntax 

3) the notion of personal application to the student, i.e. , the 
ability to talk about himself rather than about mountains and « ivers , and 
the general notions of use in everyday speech, common situations such as 
telling time, eti.*. 

Course Author* s Statement Supplementing Published Course Objectives 

The statement presented below was provided by the course author at the out- 
set of Project D-177 to supplement the writing objectives in the SPA teacher's 
manual. 

1) The ability to duplicate all the communicative skills subsumed under the 
section on Speaking, i.e., the generation of utterances, statements and questions, 
responses to questions, etc. In essence, anything the student can say he can also 
write. 

2) The ability to put down in writing any utterance that the student can 
"process" in the audio-lingual mode, and to a limited extent, utterances that in- 
volve lexical items and structures with which the student has no familiarity. 

The student's writing will equal native standards with the following qualifi- 
cations and exceptions: 

Since some respelling is used as a teaching device in the course of the pro- 
gram, testing at various points in the program will reveal varying degrees of 
dependence on the respelling. At the conclusion of Spanish A, the only devia- 
tions from conventional orthography that remain are the maintenance of the dis- 
tinction between the allophones of /d/ , appearing as d and and the use of the 
omega for ^ in the stimulus material. In the student's writing, however, the 
omega appears as a close approximation of a normal script r. What errors In 
orthography that do occur are likely to Include an occasional omission of the 
letter h^, the accent mark, and the appearance of the 4 to represent the letters 
b or V as a bilabial fricative. By the end of Unit 70 in Spanish B, the student 
controls fully standard orthography. 
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TABLE I2U 



PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH qunuTNG THE 

VOCABULARY ITEM TESTED AT END OP COURSE IN SPA CL^SK , SHOWING THE 
fiONTEXT IN WHICH EACH RESPONSE WAS SOUGHT 
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TABLE I2U Continued 













\ 


Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


29 


Es mi mamA. 


100 




hh 


Es mi nifio. 


96 


30 


fengo un plato 


90 






Tengo suefio. 


90 




de sopa. 




















U6 


Son altos. 


93 


31 


£Es un pino? 


81 


















U7 


Tengo hambre. 


86 


32 


£Es un oso? 


96 


















U8 


Hay una mesa en 


96 


33 


Tienen una 


96 






la cocina. 






mufleca. 




















U9 


Es un mozo. 


98 


3h 


Si, duerme. 


100 


















50 


Tomo 


96 


35 


Sancho tiene 


100. 












una paloma. 






51 


La cama es 


93 












pequefia. 




36 


Corta el pan. 


93 


















52 


Mi papd es 


96 


37 


Es mi mano. 


96 






guapo. 




38 


La nifia pone la 


90 




53 


Sancho toma 


100 




taza en la mesa. 








leche . 




39 


Es came. 


86 




5U 


Mi mama es baja. 


90 


UO 


Es una casa. 


100 




55 


Tengo una cama. 


92 


Ul 


Tengo una 


87 




56 


Es ml nlho. 


93 




cuchara. 




















57 


Es otra paloma. 


8U 


k2 


Es mi papd. 


100 


















58 


cDe qui^n es la 


h2 


U3 


Tiene sed. 


80 






mufleca? 






• 













L 



o 
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TABLE 124 Continued 

















Numl)er 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


59 


En la casa. 


100 




75 


£QuA toma su mamA? 


81 


60 


Uated tiene un 


86 




76 


£CuAndo come 


75 




080 • 






usted? 


6l 


£CuAntoa niflos 


93 




77 


Come porque tiene 


87 




hay en la casa? 








hambre . 


62 


iQuA es? 


98 




78 


Ndmero cuatro. 


100 


63 


Salgo con mi oso. 


92 




79 


Es francAs. 


80 


64 


Nfimero uno. 


100 




80 


PapA niamA. 


93 


65 


Mi papA come. 


96 




81 


Es de Espafia. 


100 


66 


NClmero seis. 


96 




82 


£D6nde come el 
oso? 


68 


67 


No, pero tiene 


84 












dos hermanos . 






83 


NCunero cinco. 


100 


68 


N(!lmero dos. 


100 




84 


Esta tarde no 


86 












quiero comer. 




69 


Si, ^ im oso. 


96 


















85 


Son dos nifias. 


86 


70 


LEs ^ cama? 


93 


















86 


Es de Francia. 


98 


71 


£QuA hay en la 


80 






iPor quA come 




casa? 






87 


80 


usted? 


72 


Gracias. 


98 




88 


LEn quA parte de 


93 


73 


Nfimero tree. 


100 






la casa hay una 
meS'-.? 




74 


MamA o papA. 


96 


















89 


£QuA hacen las 
nifias? 


90 



T 



1 

! 

1 

I. 

I 

I 
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TABLE I2U Continued 





TABLE 12k Continued 






27k 



Number 

of 

Item 


Item 


Percentage 
of Students I 
Answering 


- 




Correctly I 



lh2 



La mujer es alta. 

Son zapatos negros 

Es f uerte . 

Tiene una peseta . 

Es mi f am ilia . 

Toca la gultarra . 

Es un gato . 

Escuchamos la 
mdslca. 

Tiene dlnero . 

iQuS hora es? 

Toca la campana . 

El papel es bianco. | 

Tiene un amigo . 

lAdi6s! 

Tengo medio queso. 

& CuAnto vale esa 
blusa? 

Susana canta bien. 



Number 

of 

Item 



87 


143 


84 1 


144 


96 




65 


145 


98 


146 


100 


147 


98 


l48 


78 


149 


90 




86 


150 


81 


151 


81 


152 


93 




100 


153 


80 


154 


87 


155 


96 


156 



Item 



Percentage 
of Students 
Answering 
Correctly 



Ndmero trescientos . 

Usted es muy 
simpAtica . 

Quiero mi abrigo. 

Nuestra casa es 
pequefia. 

NtSmero doce . 

Hay treinta 
minutos. 

£QuiAn tiene mAs 
dlnero? 

SI, con mucho 
gusto . 

NAmero once . 

Llegamos a las 
ocho. 

NAmero trece . 

Tengo que escrlblr 
una carta. 

Es dAbil. 



iPref iere usted 
I baiiar? 
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TABLE 12U Continued 















Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


157 


Hay sesenta 


93 


171 


Estudio el 


98 




segundos . 






espafiol. 




158 


iA qui hora 


81 


172 


iQuiSn es este 


80 




estudia usted? 






muchacho? 




159 


El pez es muy 


93 


173 


iQuS dice Tomds? 


71 




pequefio. 
















174 


Quiero cantar. 


84 


160 


iQuS quiere decir 


59 










’’alumno"? 




175 


iCuAntos son 


90 










nueve menos uno? 




161 


Ndbero setenta. 


7 U 














176 


Ndmero cien. 


87 


162 


Creo que Felipe 


70 










lo tiene. 




177 


No tengo bastante 


81 










dinero . 




163 


Como mAs que ella. 


U 8 














178 


No tiene prisa. 


58 


16U 


Esta noche no 


75 










quiero comer. 




179 


Come mAs que 


68 










ellos . 




165 


Es fScil. 


80 














180 


No sA ai es mAs 


53 


166 


iQuS quiere 


80 




alta. 






comprar? 
















181 


iQuiAnes son? 


70 


167 


Somos hermanos. 


75 














182 


Tiene cinco afios. 


86 


168 


iDe quS color es 


90 










el cuchillo? 




183 


Ndmero cincuenta. 


98 


169 


La nifia tiene un 


87 


I8U 


Estudio la 


96 




oso tambiSn. 






historia. 




170 


Quiero escuchar 


90 


185 


La blusa es verde. 


84 




una canci 6 n. 
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276 















Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


186 


Es necesario 


90 


202 


Sale de la casa 


59 




comer • 






temprano . 




187 

188 


Ndmero siete. 


96 


203 


Ese plato es 
negro. 


59 


Felipe come poco. 


70 


20 U 


Ndmero diez. 


96 




189 


Ensefia el espafiol. 


81 

96 


205 


El gato no puede 


UO 


190 


El oso es 




salir. 






amarillo . 




206 


Ndmero cuarenta. 


98 


191 


Buenas tardes. 


87 


207 


iQuiSnes son 


78 


192 


NCimero ocho. 


100 




estas muchachas? 




193 


De nada. 


96 


208 


Hay tres cosas en 
la mesa. 


93 


19 U 


Estudio el inglAs. 


100 


209 


Ndmero nueve. 


98 


195 


Ndmero noventa. 


96 


210 


La casa es azul. 


92 


196 


iSaben ustedes 
muchas cosas? 


7U 


211 


Felipe llega tarde . 


8U 


197 


Ndmero quince. 


86 


212 


No s£ si es 
Sancho. 


75 


198 


Esta mafiana no 
quiero comer. 


80 


213 


Aprendemos mucho. 


80 


199 


NOmero catorce. 


93 


21 U 


EstA bien. 


90 


200 


I Ay, perddn! 


7 U 








201 


Soy mis fuerte 
que 


75 
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TABLE 125 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH LISTENING 
COMPREHENSION GRAMMAR ITEM TESTED AT THE END OP THE SPA 
COURSE, WITH A DESCRIPTION OP EACH FEATURE TEUTED» 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


1 


£Qui M? 


Irregular form, verb "ser," 
3rd person slngtilar, pres- 
ent tense 


Mvi(7) 


97 


2 


Tengo un oso. 


Irregular form, verb 
"tener," 1st person singu- 
lar, present tense 


Mvi(U) 


72 


3 


Son mis pipas. 


Noun phrase as subject (un- 
expressed), verb "ser", 
noun phrase as predicate 
nominative 


la(u) 


85 


k 


Si , es mozo . 


Possessive adjective, 1st 
person singular with sin- 
gular noun (masc. or fern.) 


Ma(6) 


100 


5 


Es la mufieca de la nifia. 


Use of "de" to show pos- 
session 


NSP(l) 


70 


6 


Mi papa no toma cafS. 


Recognition of negative 
signal preceding verb in 
utterance with subject 
expressed 


N(l) 


100 


7 


£Es ^ mono? 


Possessive adjective, 3rd 
person singular with sin- 
gular noun (masc. or fern.) 


Ma(8) 


83 



* In items testing morphology, the featiire tested is underlined. The Items are listed 
in the order in which they were presented to students on the final test. The response 
alternatives were printed English sentences. 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies 
to all three courses. An explanation of the system is given in a note at the end of 
Table 115, p. 2l8. 
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TABLE 125 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


8 


Tiene el oso y el mono. 


Noun phrase as subject 
(unexpressed) , transitive 
verb, noiui phrase as 
direct object 


3a(u) 


91 


9 


La nifia guapa entra en la 
casa. 


Position of descriptive 
adjective following noim 


NSP(2) 


83 


10 


Sale de la casa. 


Regular form, verb "salir," 
3rd person singular, 
present tense 


Mvr(7) 


43 


11 


Fuma una pipa. 


Regular form, "ar" verb, 
3rd person singular, 
present tense 


Mvr(3) 


4l 


12 


No, los nifios no toman 
caf8. 


Negative pattern; noun 
phrase as subject, nega- 
tive particle, transitive 
verb, no\m phrase as 
direct object (in sentence 
following the utterance 
"No") 


N(ll) 


95 


13 


£De d6nde es Elena? 


Interrogative pattern (in- 
formation question) : in- 

terrogative phrase, verb 
"ser," noun phrase as 
subject 


7(7) 


52 


lU 


iTiene Sancho una pipa? 


Interrogative pattern (yes- 
no question): transitive 

verb, noun phrase as sub- 
ject, noun phrase as 
direct object 


7(4) 


81 


15 


No come pan. 


Recognition of negative 
signal in initial position 
in utterance with subject 
unexpressed 


N(2) 


95 



i 

♦ 

f 



I 



I. 

o 



ERIC 
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TABLE 123 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


16 


Duerme con una inufieca. 


Noun phrase as subject (un- 
expressed), intransitive 
verb, adverb 


2a(u) 


79 


17 


Es mi hexmano. 


Masculine singular noun 
with "o" ending 


Mh(l) 


89 


18 


Los nifios tienen mi oso. 


Noun phrase as subject, 
transitive verb, noim 
phrase as direct object 


3a 


97 


19 


Soy flaco. 


Irregular form, verb "ser," 
1st person singular, 
present tense 


Mvi(5) 




20 


El oso es gordo. 


Noun phrase as subject, 
verb "ser,” predicate 
adjective 


lb 


93 


21 


£Qu8 pone la nifia en la 
mesa? 


Interrogative pattern 
(information question): 
interrogative word, transi- 
tive verb, noun phrase as 
subject 


?(5) 


75 


22 


No es la casa de los osos. 


Negative pattern: noun 

phrase as subject (unex- 
pressed) , negative parti- 
cle, verb "ser," noun 
phrase as predicate nom- 
inative 


N(6) 

\ 


70 


23 


cDe quiSnes son las 
pipas? 


"De" + "quien" to convey 
"whose?" 


nsp(6) 


58 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115* 

p. 218. 
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TABLE 125 continued 



Humber 

of 

Item 


Item 


Description of 
Featxire Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


2U 


No, Sancho no es una nifia. 


Recognition of negative 
signal preceding verb in 
utterance with subject 
expressed (following the 
utterance "No” ) 


N(3) 


91 


25 


Comen el <}ueso. 


Regiilar form, "er" verb, 
3rd person plural, present 
tense 


Mvr(lO) 


U5 










26 


iD8nde duerme la paloma? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, intran- 
sitive verb, noun phrase 
as subject 


7(6) 


66 


27 


£Qu 8 son? 


Irregular form, verb "ser," 
3rd person plural, present 
tense 


Mvi(9) 


68 


28 


Los nifios no fuman una 
pipa. 


Negative pattern: noun 

phrase as subject, nega- 
tive paziilcle, noun phrase 
83 direct object 


N(5) 


91 


29 


Tiene la£ taza£. 


Plural article and plural 
noun signals 


Mn(U) 


91 


30 


iEs gordo su mono? 


Interrogative pattern (yes- 
no question): verb "ser," 

predicate adjective, noun 
phrase as subject 


?(8) 


6k 


31 


Hay un oso en la casa. 


Verb "hay," noun phrase as 
subject, ^verb 


6a 


93 


32 


Papi lo come. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb 


3aa 


35 


33 


Salimos esta noche. 


Regular form, verb "salir," 


Mvr(9) 


U3 






1st person plural, present 
tense 
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TABLE 125 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


CodeT^ 


Percentage 
of Students 
Answering 
Correctly 


3U 


dToca el piano tambi^n? 

0 


Interrogative signal (in- 
tonation in yes-no ques- 
tion) with noun phrase as 
subject unexpressed 


?(2)’ 


72 


35 


Las nifias quieren cantar. 


Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 


5f 


77 


36 


Llevan pantalones. 


Regular form, "ar" verb, 
3rd person plural, present 
tense 


Mvr(5) 


25 










37 


El nifio tiene que salir. 


Noun phrase as subject, 
transitive verb, relator 
word, infinitive of verb 


5g 


62 


38 


Teresa las tiene. 


Pronoun direct object, 
feminine plural 


Mp(U) 


50 


39 


El pap$ lee un libro a su 
hija. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator word, noun phrase 
as indirect object 


Ua 


72 


UO 


Quiero comer. 


Noun phrase as subject 
(unexpressed) , transitive 
verb with verb infinitive 
as complement 


5f(u) 


85 


Ul 


Somos hermanos. 


Irregular form, verb "ser,' 
1st person plural, present 
tense 


' Mvi(8) 


39 










U2 


Tengo que estudiar. 


Noun phrase as subject 
(unexpressed), transitive 
verb, relatoi word, infin- 
itive of verb 


5g(u) 


72 



The coding system was designed as an aid in referring 
tests in listening and speaking grammar and grammar transfer, 
to all three courses. An explanation of the system is give 

Table 115 t P. 218. 



to identical features across 
The coding system applies 
in a note at the end of 
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TABLE 12^ continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


U3 


Si, queremos salir. 


Regular form, verb 
"querer," 1st person plural, 
present tense 


Mvr*(13) 


37 


kk 


Los nifios cantan bien. 


Noun phrase as subject, in- 
transitive verb, adverb 


2a 


85 


U5 


iQuiere escribir TomAs? 


Interrogative pattern: 
transitive verb vith verb 
infinitive as conqplement, 
noun phrase as subject 


?(11) 


60 


U6 


Canto una canciSn. 


Regiilar form, "ar” verb, 
1st person singular, 
present tense 


Mvr(l) 


6U 


U7 


iTlene usted que estudiar? 


Interrogative pattern (yes- 
no question): transitive 

verb, noun phrase as sub- 
ject, relator word, in- 
finitive of verb 


?(12) 


56 


U8 


No lo creo. 


Negative pattern: noun 

phrase as subject (unex- 
pressed) , negative parti- 
cle, noun phrctic as direct 
object (pronoun) , transi- 
tive verb 


N(10) 


77 


U9 


Escuchamos la miisica* 


Regtilar form, "ar" verb, 
1st person plural, present 
tense 


Mvr(U) 


5U 


50 


iCanta bien Sancho? 


Interrogative signal (in- 
tonation in yes-no ques- 
tion) vith noun phrase as 
subject expressed 


?(1) 


56 


51 


Mis amigos espafioles no 
leen el inglls. 


Negative pattern: noun 

phrase as subject (modi- 
fied)* negative particle, 
transitive verb, noun 
phrase as direct object 


N(U) 


62 
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TABLE 125 continued 

% 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


52 


Digo, **Adi8s, profesor." 


: Irregular form, verb 
"decir," 1st person singu- 
lar, present tense 


Mvi(3) 


58 


53 


Las que comen mucho son 
gordas • 


Nominalized definite arti- 
cle "las" modified by a 
phrase ("Las que" to convey 
"the ones who") 


NSP(7) 


77 


5U 


Lo ensefia a su hi jo. 


Noun phrase as subject 
expressed), noun phrase as 
direct object, (pronoun), 
transitive verb, relator 
word, noun phrase as indir- 
ect object 


Ua* 


77 


55 


Sancho tiene m$s dinero 
que Felipe. 


Comparison of inequality, 
("mAs que" to convey "more 
than") 


NSP(8) 


85 


56 


No cantamos en la clase 
de Espafiol. 


Negative pattern; noun 
phrase as subject (unex- 
pressed) , negative particles 
intransitive verb, adverb 


N(6)* 


70 


57 


Es un gatito. 


Diminutive suffix "it," 
plus masculine suffix "o" 


Mn(5) 


8l 


58 


MamS ^ quiere. 


Pronoun direct object, sin- 
gular masculine 


Mp(2) 


27 


59 


No s£ si es Felipe. 


Irregular form, verb 
"saber," 1st person singu- 
lar, present tense 


Mvi(2) 


56 


60 


Nuestros amigos son altos. 


Possessive adjective, 1st 
person plural, with plural 
noun 


Ma(17) 


50 



i The coding system was designed as an aid in referring to identical featwes mtoss 
tests in listening and speaking grammar and grammar transfer. The codi^ systra a^ies 
to all three courses. An explanation of the system is given in a note at the end of 

Table 115.p.2l8. 



I 

er|c 
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TABLE 12^ continued 
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TABLE 126 

PERCEHTAOE OF STUDEHTS CORRECTLY ANSWERING EACH LISTENING 
COMPREHENSION GRAMMAR TRANSFER ITEM TESTED AT THE END OF THE 
SPA COURSE, WITH A DESCRIPTION OF EACH FEATURE TESTED* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


1 


La mufieca toma caf8. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


91 


2 


No come en la cocina. 


Recognition of negative 
signal in initial position 
in utterance with subject 
unexpressed 


N(2) 


91 


3 


£Tiene el oso una mufieca? 


Interrogative pattern (yes- 
no question): transitive 

verb, noun phrase as sub- 
ject, nona phrase as direct 
object 


?(U) 


60 


k 


Los monos salen mucho. 


Noun phrase as subject, in- 
transitive verb, adverb 


2a 


77 


5 


Es el nido alto. 


Noun phrase as subject (iin- 
expressed), verb "ser," 
noun phrase as predicate 
nominative 


la(u) 


85 


6 


No, las palomas no toman 
leche . 


Recognition of negative 
signal preceding verb in 
utterance with subject ex- 
pressed (following the 
utterance "No") 


N(3) 


89 



* In items testing morphology, the feature tested is underlined. The items are listed 
in the order in which they were presented to students on the final test. The response 
alternatives were printed English sentences. 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies 
to all three courses. An explanation of the system is given in a note at the end of 
Table 115 . p. 2l8. 
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TABLE 126 continued 



Number 

of 

Item 



Item 



Description of 
Feature Tested 



Code 



Percentage 
of Students 
Answering 
Correctly 



11 



12 



Hay un mono en el nido. 



iCuintos paces cortan los 
Inifios? 



Come el pan de la paloma. 



No es la cama. 



La cocina es grande* 



Sale de la clase con el 
gato. 



13 El pez no corta el pan. 



El 080 gordo come una 
I paloma • 

koe dSnde es el mono? 



16 UEs Espafiola su paloma? 



Verb "hay," noun phrase as 
subject, adverb 

Interrogative pattern (in- 
formation question): in- 

terogatlve word, transi- 
tive verb, noun phrase as 
subject 

Use of "de" to show posses- 
sion 

Negative pattern: noun 

phrase as subject (^ex- 
pressed) , negative pairtlcle^ 
verb "aer," noun phrase as 
predicate nominative 

noun phrase as subject, 
verb "aer," predicate ad- 
jective 

Noun phrase as subject ( un- 
expressed) , intransitive 
verb, adverb 

Negative pattern . noun 
phrase as subject, negative 
particle, noun phrase as 
direct object 

Position of descriptive ad- 
jective following noun 

Interrogative pattern (in- 
formation question): in- 

terrogative phrase, verb 
"ser," noun phrase as sub- 
ject 

Interrogative pattern (yes 
no question): verb "ser," 

predicate adjective, noun 
phrase as subject 



lb 



2a(u) 



N(5) 



NSP(2) 

?( 7 ) 



?( 8 ) 



9U 



6U 



83 



71 

U8 



kk 



ERIC 
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TABLE 126 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


17 


i?oT qu8 entra el mozo 
en la cocina? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, intransi- 
tive verb, noun phrase as 
subject 


?(6) 


70 


18 


La paloma no tiene un 
nido. 


Recognition of negative 
signal preceding verb In 
utterance with subject ex- 
pressed 


N(l) 


86 


19 


£De qulSn es el vino? 


"De qul8n" to convey 
"whose” 


NSP(6) 


50 


20 


No, el mozo no come queso. 


Negative pattern : noun 

phrase as subject, negative 
particle, transitive verb, 
noun phrase as direct ob- 
ject (in sentence following 
the utterance "No") 


N(ll) 


89 


21 


Tlenen dos peceras y un 
pez. 


Noun phrase as subject (un- 
expressed) , transitive 
verb, noun phrase as direct 
object 


3a(u) 


62 


22 


El oso lo estudla. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb 


3aa 


59 


23 


Tlenen que escuchar. 


Noun phrase as subject (un- 
expressed) , transitive 
verb, relator word, infin- 
itive of verb 


5g(u) 


CM 

lf\ 



^ The coding system was designed as an aid In referring to Identical features across 
tests In listening and speaking grammar and grammar transfer. The coding system applies 
to all three courses. An explanation of the system Is given In a note at the end of 
Table 11^ p. 2l8. 
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TABLE 126 continued 



! ^ 



Number 

of 

Item 

2U 



25 



26 



27 



28 



29 



30 



31 



I El mono canta la cancl6n 
al nlfio. 



No escribe la historia en 
la escuela. 



El pez quiere leer« 



Los que llevan camisas 
son hermanos. 



Preferimos tocar* 



La cantan al oso. 



Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator vord, noun phrase 
as indirect object 


Ua 


62 


Negative pattern: noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, transitive verb, noun 
phrase as direct object 


N(6)' 


UO 


Noun phrase as subject, 

1 transitive verb with verb 
1 infinitive as complement 


5f 


58 


Nominalized definite arti- 
cle "los" modified by a 
phrase ("Los que" to con- 
1 vey "the ones who" ) 


NSP(7) 


ko 


iNoun phrase as subject (j^T 
expressed), transitive verb 
with verb infinitive as 
complement 


5f(u) 


50 


Noun phrase as subject (jm- 
I expressed) , noun phrase as 
direct object (pronoun), 
transitive verb, noun 
[phrase as indirect object 


Ua* 


31 


[interrogative signed (in- 
tonation in yes-no ques- 
[tlon) with noun phrase as 
subject unexpressed 


?(2) 


37 


.[Noun phrase as subject, 

1 transitive verb, relator 
word, infinitive of verb 


5g 


55 



. ^ 

ERIC 



i 
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TABLE 126 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


32 


iQuieren cantar los 
elef antes? 


Interrogative pattern: 
transitive verb with verb 
Infinitive as complement, 
noun phrase as subject 


?(11) 


31 


33 


El gato amarillo no come 
peces . 


Negative pattern : noun 

phrase as subject (modi- 
fied), negative particle, 
transitive verb, noun 
phrase as direct object 


N(U) 


51 


3U 


iTiene que bailar la 
paloma? 


Interrogative pattern: 
transitive verb, relator 
word. Infinitive of verb, 
noun phrase as subject 


?(12) 


37 


35 


Los osos compran mAs 
leche que los gatos. 


Conq>arlson of Inequality, 
("mAs que" to convey "more 
than") 


NSP(8) 


39 


36 


^Escribe bien su mono? 


Interrogative signal (In- 
tonation In yes-no ques- 
tion) with noun phrase as 
subject expressed 


?(1) 


55 


37 


No lo hace. 


Negative pattern : noun 

phrase as subject (unex- 
pressed) , negative parti- 
cle, noun phrase as direct 
object (pronoun), transi- 
tive verb 


N(10) 


21 


38 


iQuiere el gato ensefiarlo? 


Interrogative pattern: 
transitive verb, noun 
phrase as subject, transi- 
tive verb complement, noun 
phrase as direct object 
(pronoun) 


?(13) 


33 



^ The coding system was designed as an aid In referring to Identical features across 
tests In listening and speaking grammar and grammar transfer. The coding system applies 
to all three courses. An explanation of the system Is given In a note at the end of 
Table I 15 , p. 218. 
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TABLE 127 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH SPEAKING VOCABULARY 
ITEM TESTE D AT END OP COURSE IN SPA CLASSES, SHOWING 
THE CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 

















Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


1 


Es una mesa. 


85 




17 


Es un pino. 


44 


2 


Es una pifia. 


83 




18 


Es un oso. 


89 


3 


Es un niho 
(muchacho). 


93 




19 


Es una mufieca. 


83 


k 


Es un vaso. 






20 


Es una paloma. 


71 


75 
















21 


Es una mano. 


6l 


5 


Es un pez. 


63 




22 


Es una casa. 


89 


6 


Es un cuchillo. 


63 




23 


Es una cuchara. 


73 


7 

8 


Es una taza. 


51 




24 


Es mi hermano. 


63 


Es una pecera. 


53 




25 


Es la cocina. 




77 


9 


Es un nido. 


75 




26 


Es el mozo. 


73 


10 


Es una cama. 


77 










Es un dormitorio. 


83 




27 


Es queso. 


■ 48 


11 








12 


Es un pozo. 


36 




28 


Es pan. 


87 










29 


Es cafS. 


95 


13 

14 


Es una pipa. 


95 




30 


Es vino. 


81 


Es una puerta. 


22 




31 


Es mamd. 




100 


15 

16 


Es un plato. 


85 




32 


Es leche. 


95 


Es un mono. 


93 
















33 


Es sopa. 


93 



* Vocabulary items are underlined. The Spanish utterances are listed in the 
order in which they were presented to students on the final test. The required student 
response was a brief Spanish utterance. Only the underlined words were scored. 
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TABLE 127 Continued 
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TABLE 127 Continued 



j 



I 

I 



1 

















Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


106 


Es un mel6n. 


73 




123 


Es el papel. 


69 


107 


Es una fruta. 


87 




12U 


Es mtlsica. 


89 


108 


Es una clase. 


91 




125 


Es dinero. 


67 


109 


Es una muchacha 


87 




126 


Es historia. 


81 




(niila) . 


36 




127 


Es negro. 


89 


no 


Es una falda. 


















128 


Es bianco. 


85 


111 


Es un piano. 


77 




129 


Es necesario. 


30 


112 


Es un libro. 


83 




130 


Es azul. 


79 


113 


Es una mujer 
( sefiora ) . 


51 




131 


Es fScil. 


Ik 


llU 


Es un zapato. 


65 




132 


Es verde. 


55 


115 


Es una familia. 


51 




133 


Es amarillo. 


83 


ll6 


Es una guitarra. 


95 




13k 


Es simp^tico. 


6l 


117 


Es un gato. 


75 




135 


Es fuerte. 


57 


118 


Es una hora. 


U8 




136 


Es dgbil. 


16 


119 


Es una campana. 


2k 




137 


Escribe. 


32 


120 


Es un segundo. 


22 




138 


Lee. 


53 


121 


Es mi hijo. 


U8 




139 


Lleva un abrigo. 


3k 


122 


Es mi profesor 
(profesora ) . 

j 


81 




lUo 


Escucha . 


28 



o 
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TABLE 127 Continued 













-1 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


1I4I 


Toca el piano. 


51 


159 


Somos hermanos. 


2 


1U2 


Quiero comer. 


16 


160 


1 Es medio queso. 


36 


1U3 


Llega. 


8 


161 

162 

163 


CuSnto vale. 
Canta bien. 
Quiero mSs. 


8 

59 

18 


Ikk 


Prefiero bailar. 


30 


1^5 


Creo que es de 
Felipe. 


16 


1U6 


Ensefia espaflol. 


U 6 


16k 1 


Tengo que escribir. 


2 


IU7 


Sabe muchas cosas. 


12 


165 


Estudio ingles. 


85 


IU8 


Aprende espafiol. 


26 


166 


El llega tarde. 


20 


1U9 


Dice muchas cosas. 


3 k 


167 


Sale temprano. 


26 


150 


Estudio. 


51 


168 


Quiero comprar. 


28 


151 


Puede salir. 


8 


169 


Niimero trescientos. | 


71 


152 


Lo s$ . 


Ih 


170 


Si, con (mucho) 
gusto. 


2k 


153 


Son los pantalones. 


53 


171 


A quS hora estudia. 


10 


15 h 


Quiere el libro. 


28 


172 

173 


Ndmero doce . j 

Es muy grande. 


85 

51 


155 


Buenas tardes. 


51 






156 


AdiSs. 


85 


17H 


Ndmero once . | 


87 






157 


De nada. 


U 6 


175 


QuS quiere decir. 1 


8 

20 


158 


Tiene frlo. 


20 


216 


Como mds que ella. 1 
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TABLE 127 Continued 

















Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


177 


NGmero trece. 


83 




194 


Si , s£ Marla 


18 












canta . 


i 

t 


178 


Esta noche. 


8 








i 










195 


cQuiSn es? 


i 36 


179 


Ntimero setenta. 


26 








i 










196 


Ndmero cincuenta. 


j 36 


180 


Quiero cantar. 


22 








i 










197 


Tiene (any 


1 

30 


I8l 


Nfimero ocho. 


97 






number) afios. 




182 


Esta maflana. 


18 




198 


Come poco. 


20 


183 


Nfimero noventa. 


55 




199 


Ndmero siete. 


91 


184 


Perd6n . 


26 




200 


Quiero bailar. 


36 


185 


De qu§ color es. 


30 




201 


Ese plato. 


l4 


186 


Nfimero quince. 


65 




202 


NGmero catorce. 


59 


187 


Ella canta tambi^n. 


38 




203 


Ndmero diez. 


89 


188 


Este nifio. 


2 k 




204 


6QuI€nes son 


8 












estas nifias? 




189 


dCu^nto es nueve 


ko 












menos uno? 






205 


Ndmero cuarenta. 


46 


190 


NGmero cien 


61 




206 


Hay tres cosas. 


53 




(ciento). 










X J 










207 


Ndmero nueve. 


93 


191 


Felipe tiene 


12 








✓ «•>» 




bastante. 






208 


EstA bien. 


10 


192 


El tiene prisa. 


6 




209 


6Es |1? 


AW 

26 


193 


6 Son ellos? 


k 
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TABLE 128 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH SPEAKING GRAMMAR 
ITEM TESTED AT THE END OF THE SPA COURSE, SHOWING RESULTS OF 
SCORING ON DISCRETE ELEMENTS AND ON ENTIRE UTTERANCE** 



Number 

of 


Item 


Description of 
Feature Tested 


Code/ 


Percentage of Students 
Answering Correctly 


Item 




Discrete 

Element 


Entire 

Utterance 


1 


Un gato en un animal. 


Noun phrase as subject, 
verb "ser," noun phrase as 
predicate nominative 


la 


76 


37 


2 


Es la una. 


Definite «\rtlcle plus num- 
ber in reference to tell- 
ing time 


NSP(U) 


7U 


60 


3 


Mi casa es pequefia 


Noun phrase as subject 
verb "ser," predicate 
adjective 


lb 


82 


62 


k 


Sancho compra un 
libro. 


Noun phrase as subject, 
transitive verb, noun 
phrase direct object 


3a 


62 


37 


5 


Yo quiero aprender 
el espaftol. 


Definite article with 
name of language 


NSP(9) 


3 


0 


6 


No lo tengo. 


Negative pattern: noun 

phrase as subject (un- 
expressed), negative part- 
icle, noun phrase as 
direct object (pronoun) 
transitive verb 


N(10) 


11 


9 


7 


Es el muchacho del 
oso. 


Contraction "de" + "el" 
to "del" 


NSP(IO) 


11 


9 



** Items are listed in the order in which they were presented to students on the final 
test. In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to be completely free of error 
for the response to be marked correct. A complete listing of the elements required in each 
student response is presented in Table 129, P> 302. 

/ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 11^, 

p. 218. 



I 

o 

ERIC 
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TABLE 128 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage of Students 
Answering Correctly 


Discrete 

Element 


Entire 

Utteremce 


8 


Sancho lo lleva. 


Noiin phrase as subject, 
noiui phrase as direct ob- 
ject (pronoun), transi- 
tive verb 


3aa 


9 


9 


9 


iTiene Marla un 
abrigo azul? 


Position of descriptive 
adjective following noun 


NSP(2) 


35 


7 


10 


La mufleca duerme en 
la cama. 


Noiin phrase as subject, 
intransitive verb, adverb 


2a 


72 


66 


11 


Las (muchachas) que 
comen mucho son 
gordas. 


Nominalized definite arti- 
cle "las" modified by a 
phrase ("las que" to con- 
vey "the ones who") 


NSP(7) 


1 


1 


12 


Sancho tiene mSs 
dinero que Maria. 


Comparison of inequality 
CWs" plus "que" to con- 
vey "more than") 


NSP(8) 


27 


25 


13 


El profesor ensefia una 
canci6n a los alumnos. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator word, noun phrase 
as indirect object 


Ua 


21 


7 


lU 


La mamS lee al nifio. 


Contraction of "a" + "el" 
to "al" 


NSP(ll) 


1 


1 


15 


Los muchachos quieren 
bailar. 


Noun phrase as subject, 
transitive verb with verb 
Infinitive as complement 


5f 


33 


9 


16 


Yo tengo que estudiar. 


Noun phrase as subject, 
transitive verb, relator 
word. Infinitive of verb 


5g 


1 


1 


17 


Hay cinco vasos en la 
mesa. 


Verb "hay," noun phrase 
as subject, adverb 


6a 


58 


5U 


18 


Es el oso de Sancho. 


Use of "de" to indicate 
possession 


NSP(l) 


29 


19 
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TABLE 128 continued 



Number 


Item 


Description of 
Feature Tested 




Percentage of Students 
Answering Correctly 


of 

Item 


OOdGf 


Discrete 

Element 


Entire 

Utterance 


19 


No, Sancho no es 
simpNtico. 


Negative pattern: noun 

phrase as subject, nega- 
tive particle, verb "ser,” 
predicate adjective (in 
sentence following the 
utteramce "No”). 


N(ll) 


37 


33 


20 


El papa lo enseha a su 
hijo. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb, relator word, noun 
phrase as indirect object 


Ua' 


0 


0 


21 


£Escucha Marla la 
mOsica? 


Interrogative pattern 
(yes-no question) : tran- 

sitive verb, noun phrase 
subject, noun phrase as 
direct object 


?(U) 


5 

1 


3 


22 


£De qui8n es el oso? 


De + qulen to express 
"whose" 


NSP(6) 


7 


3 


23 


£Compra Marla una 
mufieca grande? 


Interrogative pattern 
(yes-no question): tran- 

sitive verb, noun phrase 
subject, noun phrase as 
direct object (modified) 


?(U') 


9 


7 


2U 


£D6nde canta Sancho? 


Interrogative pattern 
(information question): 
interrogative word, in- 
transitive verb, noun 
phrase as subject 


?(6) 


29 


15 


25 


£Es grande su casa? 


Interrogative pattern 
(yes-no question): verb 

"ser," predicate adjective 
noun phrase as subject 


?(8) 


7 


5 



/ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115 » 
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TABLE 128 continued 



Number 

of 

Item 


Item/ 


Description of 
Feature Tested 




Percentage of Students 
Answering Correctly 


1^0 U0 


Discrete 

Element 


Entire 

Utterance 


26 


iPor quS no come 
Maria? 


Negative>interrogative 
pattern : interrogative 

word, negative particle. 
Intransitive verb, noun 
phrase as subject 


N(12) 


23 


23 


27 


£QuS lleva Maria? 


Interrogative pattern 
( information question ) : 
interrogative word, tran- 
sitive verb, noun phrase 
as subject 


?(5) 


U3 


37 


28 


£De d 6 nde es Maria? 


Interrogative pattern 
(information question): 
interrogative phrase, verb 
"ser," noun phrase as sub- 
ject 


?(7) 


13 


11 


29 


iCantan las mujeres? 


Interrogative pattern 
(yes-no question): in- 

transitive verb, noun 
phrase as subject 


?( 10 ) 


11 


11 


30 


(Si.) Soy fuerte. 


Irregular form, verb 
"ser," first person singu- 
lar, present tense 


Mvi(5) 


7 


7 


31 


( Yo . ) Lo s 8 . 


Irregular form, verb 
"saber," first person 
singular, present tense 


Mvi(2) 


1 


0 


32 


(No. ) Es el nifi£. 


Agreement masculine singu- 
lar article + masculine 
singular noun ending in 0 


Mn(l) 


33 


31 


33 


(No.) Nuestra 
muchach£ canta bien. 


Agreement first person 
plural feminine possessive 
adjective + feminine 
singular noun 


Ma(9) 


3 


3 



^ Items 30-U9 test morphology, 
underlined. 



In each item the specific morphological feature tested is 
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TABLE 120 continued 



Number 

of 

Item 



3U 



35 



36 



39 



UO 



Ul 



U2 



U3 



Item 



Description of 
Feature Tested 



(Si.) (Usted) sale 
temprano. 



(SI.) (Yo) canto 
bien. 



(Si.) (Marla) las 
tlene. 

(Marla) tiene dos 
blueas verdes. 



(Si.) Son sus libroSi 



( ^ pipa) es amarilla. 



(No.) Sancho toma 
leche. 



(Si.) Llegamos a las 
ocho. 



( Si . ) ( Sancho ) lo 

tiene . 



Regular form, verb 
"salir," 2nd person singu- 
lar, present tense 

Regulcu* form, ”ar" verb, 
1st person singular, pre- 
sent tense 

Feminine plural, direct 
object pronoun 

Agreement of feminine 
plural noun + adjective 
with ”es” ending 

3rd person plural possess- j 
ive adjective with plural 
noun 

Agreement of feminine 
singular noun (+ verb 
"ser”) + feminine singu- 
lar adjective 

Regulau:' form, ”ar” verb, 

3rd person singular, pre- 
sent tense 

Regular form, ”ar" verb, 
first person plural, pre- 
sent tense 

Masculine singular, direct] 
object pronoun 



Code/ 



Los nifios toman leche. | Regular form, ”ar” verb, 

3rd person plural, present 
tense 



Mvr(5) 



Mvr(7) 



Mvr(l) 



Ma(l2) 



Ma(3) 



Mvr(3) 



Mvr(l*) 



Mp(2) 



teatfl designed as an aid in referring 

listening and speaking grammar and grammar transfer. 

^ An explanation of the system is given in 

P« 2l0e 



Percentage of Students 
Answering Correctly 



Discrete 

Element 



Ut 



21 



23 



31 



68 



19 



Entire 

Utterance 



37 



15 



21 



23 



50 



17 



to identical features across 
The coding system applies to 
a note at the end of Table 115 » 
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TABLE 128 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage of Students 
Answering Correctly 


Discrete 

Element 


Entire 

Utterance 


kk 


(Yo) digo adi6s. 


Irregular form, verb 
"decir," first person 
singular, present tense 


Mvi(3) 


3 


3 




(No.) Sancho es un 
nifio. 


Irregular form, verb 
"ser," third person singu- 
lar, present tense 


Mvi(7) 


68 


hi 


k6 


Los hombres son altos. 


Irregular form, verb 
"ser,” third person 
plural, present tense 


Mvi(9) 


50 


35 


hi 


(El) (oso) es amarill£. 


Agreement of masculine 
singular noun (+ verb 
"ser") + masculine singu- 
lar adjective 


Ma(l) 


52 


39 

*■ 


hQ 


No, son la£ nina£. 


Agreement plural article 
* plural noun 


Mn(U) 


23 


5 


h9 


(Sancho) tiene dos 
(camisas) blancas . 


Agreement of feminine 
plural noun + feminine 
plural adjective 


Ma(U) 


17 


15 



er|c 






a 



I 



0) 

CO 

a 

a 



CO 

n 



•p 

o 

0) 

b 



o 

o 



"S 

s 

0 ) 






0 ) 

•p 

s 

o 

(0 



a 



o 

u 

CO 



V 

c 

s 

•p 



0 ) 

u 

•H 

» 



a 

•H 

O 

o 

CO 




i-s 



0 ) 

ti 

o 






0 ) 

& 



•p 

o 

0) 



tf 

g 

(fl 

u 

a 



m ^ 

g 



c\j 



CO 

» 



tf 







10 


a 






0) 


3 




o 








•o 


B 




•o 


B 


8 




g 








o 






3 


g 






CO 






>4 


UN B 




oS 


+ 


> 




U) 


o 




g 




•H 






a 


O 


B 


g 


■s 




tf 


+ 


■P 


+ 




•H 




IS 




tS 










0) 




to 


0) 


+ 


O 


-=r 


3 


p 




H 




CO 




C3* 




u 


O 




0) 




V 




o 


•H 








P 






•P 


•o 








+ 


8 


3 


9 


+ 




+ 


(0 


§ 




& 


CO 




(0 


CO 0) 


a 


0) 


t£ 


CO 0) 


CO 


0) 






•p 










+ 


u 


•H 




+ 




+ 




0) 


a 










o 


p 


•H 


IS 


d 




g 


<p 


o 




0) 






3 


CM tS 


u 


0) 


3 


cvj 8 


CVi 


o 






C3< 

HI 


o 




a 


+ 


•p 


+ 


p 


+ 




+ 




Pi 














4> 




+ 








P 


O 


CO 




p 




p 


H tS 


H 


0) 


to 




H 




' — 


0) 




H H 








'K. 






• 


• 




• 














o 



+ ^ o> ^ 



.s 

9 



9 



tf 

IS 

I 

0) 

p< 



CO 


• 


0) 


tf 




§ 


o 




a 


d 


d 


H 


U) 




J5 


CO 


D 


H 



(0 

(U 



tf 



0^ 



CM 



CO 



A detailed description of the procedures tised in scoring is presented in Chapter k of this report. 
Generally, there was more than one correct response. An alternative correct response is indicated 
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• Proper name may appear at end of sentence instead of at the beginning. 



TABLE 129 continued 





* Proper name as subject may appear at end of sentence instead of slot 2 



TABLE 129 continued 
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* Proper name may appear at end of sentence instead of in slot 2. 

^ Item is not marked incorrect if descriptive sidjective comes before noun direct object 



TABLE 129 continued 




TABLE 129 continued 




TABLE 129 continued 





310 




311 



TABLE 130 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH SPEAKING GRAMMAR TRANSFER 
ITEM TESTED AT THE END OF THE SPA COURSE, SHOWING RESULTS OF 
SCORING ON DISCRETE ELEMENTS AND ON ENTIRE UTTERANCE** 



Number 




Description of 




Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Code/ 


Discrete 

Element 


Entire 

Utterance 


1 


Un mozo as una persona 


Noun phrase as subject, 
verb, "ser," noun phrase 
as predicate nominative 


la 


77 


38 


2 


Son las tras. 


Definite article plus 
number in reference to 
telling time 


NSP(4) 


28 


18 


3 


La mesa as negra. 


Noun phrase as subject, 
verb "ser," predicate ad- 
jective 


lb 


75 


20 


U 


El profesor canta 
una canci6n. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


28 


CVi 


5 


Yo anseho el francos. 


Definite airticle with name 
of language 


NSP(9) 


2 


2 


6 

( 


No lo toroamos. 


Negative pattern : noun 

phrase as subject (unex- 
pressed), negative part- 
icle, noun phrase as 
direct object (pronoun), 
transitive verb 


N(10) 


12 


2 


7 


Es la guitarra dal 
hombre. 


Contraction of "de" + "el" 
to "del" 


NSP(IO) 


10 


2 



** Items are listed in the order in which they were presented to students on the final 
test. In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to be completely free of error 
for the response to be marked correct, A complete listing of tb^ elements required in each 
student response is presented in Table 131, p» 313* 

/ The coding system was designed as an aid in referring to identical featxires across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 113 

p, 218, 






o 
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TABLE 130 continued 
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Number 

of 

Item 



11 



16 



17 



Item 



8 El alumno lo toca. 



Sancho fuma una pipa 
negra. 

Sancho sale de la 
escuela. 

Las (muchachas) que 
comen mucho son 
gordas . 



12 1 El elefante es mSs 

fuerte que el oso. 



13 1 La nifia lee la carta 

al profesor. 



El muchacho escribe 
al hombre. 

Yo prefiero cantar. 



Porque yo tengo que 
comer. 



Hay dos alumnos en 
la clase. 



Description of 
Feature Tested 



Noim phrase as subject, 
noun phrase as direct ob- 
ject (pronoun) , transi- 
tive verb 

Position of descriptive 
adjective following verb 

Noun phrase as subject, 
intransitive verb, adverb 

Nominalized definite art- 
icle "las" modified by a 
phrase ("las que" to con- 
vey "the ones who") 



Comparison of inequality 
("m^s" + 

"more than") 



"que" to convey 



Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator word, noun phrase 
as indirect object 



Contraction of "a" + "el 
to "al" 

Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 

Noun phrase as subject, 
transitive verb, relator 
word, infinitive of verb 

Verb "hay," noun phrase as 
subject, adverb 






Code 



3aa 



NSP(8) 



Ua 



NSP(ll) 



5f 



5g 



6a 



Per cent 8ige of Students 
Answering Correctly 



Discrete 

Element 



10 



20 



16 



12 



51 



Entire 

Utterance 



lU 



U6 



ERIC 
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TABLE 130 continued 



Number 

of 


Item 


Description of 
Feature Tested 


Code/ 


Percentage of Students 
Answering Correctly 


Item 


Discrete 

Element 


Entire 

Utterance 


18 


Es la mufieca de la 
nina. 


Use of "de" to indicate 
possession 


NSP(l) 


30 


12 


19 


No, el oso no es 
flaco. 


Negative pattern : noun 

phrase as subject, nega- 
tive particle, verb 
"ser," predicate adjective 
(in sentence following 
the utterance "No") 


N(ll) 


44 


36 


20 


Sancho lo enseha a 
su papA. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb, relator word, noun 
phrase as indirect object 


4a' 


2 


2 


21 


iCome Susana el pan? 


Interrogative pattern 
(yes-no question) : tran- 

sitive verb, noun phrase 
as subject, noun phrase 
as direct object 


?(4) 


12 


10 


22 


£De d6nde es Sancho? 


Use of "de" preceding 
"dohde" to indicate 
origin 


NSP(12) 


16 


12 


23 


iTiene Sancho un mono 
negro? 


Interrogative pattern 
(yes-no question) : tran- 

sitive verb, noun phrase 
as subject, noun phrase 
as direct object (modi- 
fied) 


?(4') 


20 


16 


2k 


iPor qu€ no toma usted 
leche? 


Negat i ve-int er r ogat i ve 
pattern: interrogative 

word, negative particle, 
treuisitive verb, noun 
phrase subject, noun 
phrase as direct object 


N(12) 


l6 


8 



^ The coding system was designed as an aid in referring to identical features across 
tests in listening and speaking grammar and grammar transfer. The coding system applies to 
all three courses. An explanation of the system is given in a note at the end of Table 115, 
p. 2l8. 




TABLE 130 continued 
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Number 




Description of 




Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Code 


Discrete 

Element 


Entire 

Utterance 


25 


iEs fuerte el gato? 


Interrogative pattern 
(yes-no question): verb 

"ser," predicate adjective 
noun phrase as subject 


?(8) 


10 


8 


26 


iCu^ndo come la 
mujer? 


Interrogative pattern 
(information question): 
interrogative word, in- 
transitive verb, noun 
phrase as subject 


?(6) 


l6 


k 


2T 


£QuS come la nifia? 


Interrogative pattern 
(information question): 
interrogative word, tran- 
sitive verb, noun phrase 
as subject 


?(5) 


36 


22 


28 


oDe quiin es la 
guitarra? 


Interrogative pattern 
(information question): 
interrogative phrase, 
verb "ser," noun phrase 
as subject 


?(7) 


k 


k 


29 


iAprenden los 
alumnos? 


Interrogative pattern 
(yes-no) : intransitive 

verb, noiui phrase as 
subject 


?(10) 


10 


6 
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* A detailed description of the procedures used in scoring is presented in Chapter of this report. 

^ Generally 9 there was more than one correct response. An alternative correct response is indicated by b. 
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* Infinitive is only acceptable form of the verb. 
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* Proper naine may appear at end of sentence instead of in slot 2. 

^ Item is not marked incorrect if descriptive adjective comes before ncun direct object* 
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PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH READING COMPREHENSION 
VOCABULARY ITEM TESTED AT END OP COURSE IN SPA CLASSES, SHOWING THE 
CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 
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33U 



1 


















Number 




Percentage 


Number 




Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


29 


Es una case. 


98 


1*6 


Sancho entra en 
la cocina. 


98 


30 


Hay una pecera en 
la mesa. 


62 


1*7 


Tengo mucho 
dinero . 


90 






31 


Son altos. 


90 


1*8 


Mi mam^ es baja. 


81 


32 


Tengo hambre. 


86 










9h 


k9 


Tengo un plato de 


90 


33 


Hay una mesa en 




sopa. 






la cocina. 




50 


Mi mono es gordo. 


92 


3U 


Es un mozo. 


90 


51 


Es un nido. 


92 


35 


1 Tomo 


100 








i 

1 




52 


Salen de la casa. 


79 


36 


1 Es una cama. 


96 


53 


La cama es 


03 


37 


Mi papA es guapo. 


88 




pequeha. 




38 


Sancho toma leche. 


98 


51* 


Hay una mesa en el 
dormitorio . 


01 


39 


Es mi mamA. 


98 


55 


&Por quS come 


79 


UO 


Corta el pan. 


92 




usted? 




hi 


Es una mano. 


92 


56 


iEn quS parte de 
la casa hay una 


81* 


1*2 


La nifia pone la 


90 




mesa? 






taza en la mesa. 




57 


£QuS hacen las 


92 


1*3 


Es came. 


81* 




niflas? 




1*1* 


Mi casa es grande. 


96 


58 


Mi hermano sale 


52 






88 




conmigo . 




1*5 


Es una taza. 









o 

ERIC 
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Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


j "T 

Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


59 


No, gero tiene 


62 


75 


iQu8 toma su mamA? 


73 




dos hexnnanos. 
















76 


iCuAndo come 


71 


60 


Ndmero dos» 


96 




usted? 




6l 


Si, e£ un oso. 


90 


77 


Come porque 


73 










tiene hambre. 




62 


cEs su cama? 


86 














78 


Ndmero cuatro. 


100 


63 


Tengo una cama. 


8l 














79 


2QuA hay en la 


77 


6h 


Es nd nifio. 


96 




casa? 




65 


Es otra paloma. 


83 


80 


Gracias . 


96 


66 


cDe qui^n es la 


64 


81 


NOmero tres. 


100 




mufleca? 
















82 


MamA £ papA. 


94 


67 


En la casa. 


100 














83 


NAmero cinco. 


98 


68 


Us ted tiene un 


92 










oso. 




84 


Esta tarde no 


83 










quiero comer. 




69 


iCudntos nilios 


88 










hay en la casa? 




85 


Son dos nifias. 


84 


70 


cQuS es? 


77 


86 


Es de Francia. 


98 


71 


Salgo con mi oso. 


86 


87 


Es francAs. 


81 


72 


Ntimero uno. 


100 


88 


PapA Y, niamA. 


96 


73 


Mi papd come. 


88 


89 


Es de Espaha. 


92 


74 


Ndmero seis. 


98 


90 


iD6nde come el 


6o 








L 


oso? 





I er|c 

— 
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Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


91 


Hay dos pollltos 


83 




108 


Es una camisa. 


88 




en la mesa. 




















109 


Los hombres 


96 


92 


Un alumno duerme. 


8U 






escriben . 




93 


Lleva una camlsa. 


79 




no 


Es un animal. 


100 


9U 


Es una per a. 

\ 


98 




111 


Lee una carta. 


79 


95 


Son dos patos. 


67 




112 


Es el profesor. 


96 


96 


El hombre duerme. 


92 




113 


Quieren comer. 


88 


97 


Es una pipa 


100 




llU 


Es una blusa. 


98 




negra. 




















115 


Lleva una falda. 


73 


98 


Tlene una carta. 


86 


















116 


La muchacha es 


86 


99 


Tiene un hi jo. 


88 






guapa. 




100 


Escucha la 


92 




117 


Es una clase. 


98 




mfjsica. 




















118 


Tiene frlo. 


100 


101 


Lleva un abrigo. 


90 


















119 


Los pan t alone s son 


100 


102 


Es mi escuela. 


96 






negros . 




103 


El oso es bianco. 


8U 




120 


Toca muy bien. 


73 


lOU 


Tiene un huevo. 


8U 




121 


Prefieren bailar. 


8l 


105 


Es un elefante. 


100 




122 


Es una fruta. 


98 


106 


Es una pluma. 


86 




123 


Toca la guitarra. 


96 


107 


Corta el mel6n. 


98 




12U 


Es mi familia. 


98 
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1 


Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 

i 

1 

1 

I 








Correctly 


125 


Tiene una peseta. 


58 




lU2 


Usted es muy 


88 












simpAtica. 




126 


Es fuerte. 


90 


















IU3 


N(imero trescientos. 


9k 


127 


Son zapatos negros. 


88 


















Ikk 


Susana canta bien. 


92 


128 


La mujer es alta. 


8U 










1 


— 

1 






lk3 


iCudnto vale esa 


79 


129 i 

1 

j 


1 Es un libro. 


96 






blusa? 




130 I 

i 


1 

r 

1 Es un piano. 


100 




lk6 


Tengo medio queso. 


79 


131 1 


lAdios! 


96 




1U7 


Tengo que escribir 


88 


I 

i 










una carta . 




132 ! Tiene un amigo. 


9k 










j 








1U8 


Ndmero trece. 


67 


133 i 


El papel es 


90 










i 

1 


bianco. 






1U9 


Llegamos a las 


56 


j 










ocho. 




13k 1 


Toca la campana. 


79 


















150 


Ndmero once. 


90 


135 


&Qu§ hora es? 


90 


















151 


Si, con mucho 


83 


136 


Tiene dinero. 


8U 






gusto. 




137 


Escuchamos la 


71 




152 


iQui^n tiene mAs 


88 




mUsica. 








dinero? 




138 


Es un gato. 


96 




153 


Hay treinta 


92 












minutos . 




139 


Es una persona. 


96 


















13k 


Ndmero doce. 


8U 


lUo 


Nuestra casa es 


58 












pequefia . 






155 


Creo que Felipe lo 


71 












tiene . 




lUl 


Quiero mi abrigo. 


67 











i 
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Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Student e( 


Item 


Answering 




Item 




Answering i 




Correctly 








Correctly 


156 


Ndmero setenta. 


88 




171 


No tiene prisa. 


60 


157 


&QuS quiere decir 
"alumno"? 


6U 




172 


No tengo bastante 
dinero. 


69 


158 


El pez es muy 
pequeflo. 


90 




173 

17U 


Ndmero cien. 
iCuAntos son nueve 


90 

9U 


159 


cA quS hora estudia 
usted? 


79 






menos uno? 








175 


Quiero cantar. 


81 






160 


Hav sesenta sesundos. 


86 




176 


&Qu§ dice TomAs? 


58 


161 


iPrefiere usted 
bailar? 


8U 




177 


iQuidn es este 
muchacho? 


79 


162 


Es dSbil. 


81 




178 


Estudio el espafiol. 


88 


163 


Quiero escuchar una 
canci6n. 


79 




179 


Es necesario comer. 


90 


16U 


La nifia tiene un 
oso tambiSn. 


83 




180 


La blusa es verde. 


90 

96 










181 


Estudio la his tor ia. 


165 


&De quS color es el 
cuchillo? 


96 








83 






182 


Ndmero cincuenta. 


166 


Somos hermanos. 


79 




183 


Tiene cinco afios. 


90 


167 


&QuS quiere compar? 


69 




18U 


iQuiSnes son? 


U3 


168 


Es fdcil. 


75 




185 


No s^ si es mds 
alta. 


37 


169 


Esta noche no quiero 


79 




186 


Come mds que ellos. 


71 


comer. 






170 


Como mds que ella. 


62 




187 


Estudio el ingles. 


9U 



LerJc 

^Kysssis&iSES 
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1 








Number 




Percentage 


Number 


1 


Percentage 


of 


Item 


of Students 


of 


Item 


of Students 


Item 




Answering 


Item 




Answering 






Correctly 






Correctly 


188 


De nada « 


92 


203 


La casa es azul. 


94 


189 


Ndmero ocho. 


9k 


20k 


Ndmero nueve . 


100 


190 


Buenas tardes. 


75 


205 


Hay tres cosas en 


92 










la mesa. 




191 


El oso es amarillo. 


9k 














206 


&Qui§nes son estas 


67 


192 


Ensefia el espafiol. 


79 




muchachas? 




193 


Felipe come poco. 


79 


207 


Nfimero cuarenta. 


83 


19k 


Ndmero siete. 


9k 


208 


El gato no puede 


60 










salir . 




195 


Sale de la casa 


67 










temprano. 




209 


Ndmero diez. 


98 


196 


Soy mSs fuerte que dl. 


67 


210 


Ese plato es negro. 


86 


197 


iAy perd8n! 


15 


211 


Estd bien. 


73 


198 


Ndmero catorce. 


90 


212 


Aprendemos mucho. 


67 


199 


Esta mafiana no 


09 


213 


No ^ si es Sancho. 


81 




quiero comer. 
















214 


Felipe llega tarde. 


83 


200 


Ndmero quince. 


88 








201 


iSaben ustedes muchas 


73 










cosas? 










202 


Nfimero noventa. 


8k 
















3UO 



TABLE 136 

PERCEN TAGE OF STUDENTS CORRECTLY ANSWERING EACH READING 
COMPREHENSION GRAMMAR ITEM TESTED AT THE END OF THE 
SPA COURSE, WITH A DESCRIPTION OP EACH FEATURE TESTED* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


1 


iQuI es? 


Irregular form, verb "ser," 
3rd person singular, pres- 
ent tense 


Mvl(7) 


98 


2 


Tengo un oso. 


Irregular form, verb 
"tener," 1st person singu- 
lar, present tense 


Mvi(U) 


81 


3 


Los nifios no fuman una 
pipa. 


Negative pattern: noun 

phrase as subject, negative 
particle, noim phrase as 
direct object 


N(5) 


90 


k 


Duerme con una muReca. 


Noun phrase as subject (un- 
expressed), intransitive 
verb, adverb 


2a(u) 


75 


5 


Son mis pipas. 


Noun phrase as subject (un- 
expressed), verb "ser," 
noun phrase as predicate 
nominative 


la(u) 


9k 


6 


Es ^ mono. 


Possessive adjective, 3rd 
person singular with singu- 
lar noun (masculine or fem- 
inine ) 


Ma(8) 


77 


7 


Tiene el oso y el mono. 


Noun phrase as subject (un- 
expressed), transitive 
verb, noun phrase as direct 
object 


3a(u) 


9k 



* In items testing morphology, the feature tested is underlined. The items are listed 
in the order in vhich they were presented to students on the final test. The response 
alternatives were printed English sentences. 



^ The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table 115, p. 218. 
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TABLE 136 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


8 


La nifia guapa entra en la 
casa. 


Position of descriptive 
adjective following noun 


NSP(2) 


88 


9 


Sale de la casa. 


Regular form, verb "salir," 
3rd person singular, pres- 
ent tense 


Mvr(7) 


37 


10 


Fuma una pipa. 


Regiaar form, "ar" verb, 
3rd person singular, pres- 
ent tense 


Mvr(3) 


Ul 


11 


£De d6nde es Elena? 


Interrogative pattern (in- 
formation question): in- 

terrogative phrase, verb 
"ser," noun phrase as sub- 
ject 


?(7) 


71 


12 


iTiene Sancho una pipa? 


Interrogative pattern (yes- 
no question): transitive 

verb, noun phrase as sub- 
ject, noun phrase as direct 
object 


?(U) 


86 


13 


iQuS pone la nifia en la 
mesa? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, transi- 
tive verb, noun phrase as 
subject 


?(5) 


86 


lU 


iQufi son? 


Irregular form, verb "ser," 
3rd person plural, present 
tense 


Mvi(9) 


66 


15 


Es mi hermano. 


Masculine singular noun 
with "0" ending 


Mn(l) 


VO 

0 


16 


Los nifios tienen mi oso. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


96 


17 


Soy flaco. 


Irregular form, verb "ser," 
1st person singtilar, pres- 
ent tense 


Mvi(5) 


U7 



o 

ERIC 
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TABLE 136 continued 



Number 

of 

Items 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
of Students 
Answering 
Correctly 


18 


El oso as gordo. 


Noun phrase as subject, 
verb "ser," predicate ad- 
jective 


lb 


1 98 


19 


Comen el Queso. 


Regular form, ”er" verb, 
3rd person plural, pres- 
ent tense 


Mvr(lO) 


k9 


20 


No es la casa de los osos. 


Negative pattern: noun 

phrase as subject (\inex- 
pressed), negative parti- 
cle, verb "ser," noun 
phrase as predicate nomin- 
ative 


N(6) 


6k 


21 

j 

j 


£De quidnes son las 
1 pipas? 


"De" + "quien" to convey 
"whose?" 


NSP(6) 1 


66 


22 1 


Si, es ^ mozo. 


Possessive adjective, 1st | 
person singular with sin- 
gulaur noun (masculine or 
feminine ) 


Ma(6) 


96 


23 


Tiene las^ taza£. 


Plural eurticle and plural 
noun signals 


Mn(U) 


8k 


2k 


iDSnde duerme la paloma? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, intransi- 
tive verb, noun phrase as 
subject 


?(6) 


83 


25 


Es la mufleca de la nifia. 


Use of "de" to show pos- j 
session 


NSP(l) 

' 


79 



^ The coding system was designed as 
tests. The coding system applies to all 
given in a note at the end of Table 115 , 



«n aid in referring to identical features across 
three courses. An explanation of the system is 

p. 218. 








I 



3U3 



Number 

of 

Item 



26 



31 



33 



3U 



o 

ERLC 



TABLE 136 continued 



No, los nifios no toman 
oaf C • 



27 Ues gordo su mono? 



Hay un oso en la casa* 
[Mami quiere. 

No si es Felipe. 



32 I iQuiex^ usted comprarlo? 



Escuchamos la mdsicai 



[Mis amigos espafioles no 
leen el inglCs. 



Description of 
Feature Tested 



Code 



Negative pattern; noun 
phrase subject, negative 
particle, transitive verb, 
noun phrase as direct ob- 
jject (in sentence following 
I the utterance "No") 



I Interrogative pattern (yes-| 
jno question); verb "ser," 
predicate adjective, noun 
Iphrase as subject 



Verb "hay," noun phrase as 
subject, adverb 



Direct object pronoun "la,"| 
singular masculine 



Irregular form, verb 
"saber," 1st person singu- 
lar, present tense 



I Nuestros amigos son altos. 



Possessive adjective, 1st 
person plural, with plural 
noun 



Interrogative pattern; 
transitive verb, noun 
phrase as subject, transi- 
Itive verb as coaqplement, 

I noun phrase as direct ob- 
ject (pronoun) 



Regular form, "ar" verb, 
1st person plural, pres- 
ent tense 



Negative pattern ; noun 
phrase as subject (modi- 
fied), negative particle, 
transitive verb, noun 
phrase as direct object 



N(ll) 



?( 8 ) 



Mvr(U) 



N(U) 



Percentage 
of Students 
Answering 
Correctly 



88 



83 



6a 1 


90 


Mp(2) 


30 


Mvi(2) 


62 


Ma(17) 


62 


?(13) 


6U 



35 



8U 



J 
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TABLE 136 continued 









3UU 



Number 

of 

Item 


Item 


Description of 
Featxire Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


35 


Digo, "Adi 6 s, profesor.” 


Irregular form, verb 
"decir," 1 st person singu- 
lar, present tense 


Mvi(3) 


60 


36 


Las que comen mucho son 
gordas. 


Nominalized definite arti- 
cle "las" modified by a 
phrase ("Las que" to convey 
"the ones who") 


NSP(7) 


83 


37 


Lo ensefla a su hi jo. 


Noun phrase as subject (un- 
expressed), noun phrase as 
direct object (pronoun), 
transitive verb, relator 
word, noun phrase as in- 
direct object 


Ua* 


62 


38 


Sancho tiene mds dinero 
que Felipe. 


Comparison of inequality, 
("mis que" to convey "more 
than") 


NSP( 8 ) 


88 


39 


No cantamos en la clase 
de Espafiol. 


Negative pattern: noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, intransitive verb, 
adverb 


N( 6 )' 


75 


UO 


Es un gat it 0 . 


Diminutive suffix "it," 
plus masculine suffix " 0 " 


to(5) 


88 


Ul 


iQuiere escribir Tomis? 


Interrogative pattern: 
transitive verb with verb 
infinitive as cooq;>lement, 
noun phrase as subject 


?( 11 ) 


69 


k2 


Canto una canci 6 n. 

^ 1 


legular form, "ar" verb, 
1 st person singular, pres- 
ent tense 


Mvr(l) 


66 



The coding system vas designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table 115, p.2l8. 
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TABLE 136 continued 



Number 

of 

Item 


Item 


Description of 
Feat lure Tested 


Code 


Percentage 
of Students 
Ansvering 
Correctly 




iTiene usted que estudiar? 


Interrogative pattern (yes- 
no question): transitive 

verb, noun phrase as sub- 
ject, relator word, infini- 
tive of verb 


?(12) 


39 


kk 


No lo creo* 


Negative pattern : noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, noun phrase as direct 
object (pronoun), transi- 
tive verb 


N(10) 


69 


U5 


El nifio tiene que salir* 


Noun phrase as subject, 
transitive verb, relator 
vord, infinitive of verb 


5g 


71 


U6 


Teresa las tiene. 


Direct object pronoim, fem- 
inine plural 


f^(4) 


60 


U7 


El papA lee un libro a su 
hija. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator vord, noun phrase 
as indirect object 


4a 


79 


48 


Quiero comer. 


Noim phrase as subject (un- 
expressed), transitive verb 
with verb infinitive as 
complement 


5f(u) 


77 


49 


Somos hermanos. 


Irregular form, verb '*ser,'* 


Mvi(8) 


71 






1st person plural, present 
tense 






50 


Tengo que estudiar. 


Noun phrase as subject (un- 
expressed), transitive 
verb, relator vord, infini- 
tive of verb 


5g(u) 


81 


51 


Si, queremos salir. 


Regular form, verb "querer,” 
1st person plural, present 
tense 


Mvr'(l3) 


35 







3U6 



TABLE 136 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code^ 


Percentage 
of Students 
Answering 
Correctly 


52 


Los nifios cantan bien* 


Noun phrase as subject, in- 
transitive verb, adverb 


2 a 


88 


53 


Papi lo come* 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb 


3 aa 


U9 


5U 


Salimos esta noche* 


Regular form, verb "salir,” 
1 st person plural, present 
tense 


Mvr(9) 


56 


55 


Las nifias quieren cantar* 


Noun phrase as subject, 
transitive verb with verb 
Infinitive as complement 


5f 


71 


56 


Llevan pantalones* 


Regular form, ”ar” verb, 
3 rd person plural, present 
tense 


Mvr(5) 


58 



^ The coding lystem was designed as an aid in referring to identical features across 
tests* The coding system applies to all three courses* An explanation of the system is 
given in a note at the end of Table 113* P* 218* 
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TABLE 137 

PERCENTAGE OP STUDENTS CORRECTLY ANSWERING EACH READING 
COMPREHENSION GRAMMAR TRANSFER ITEM TESTED AT THE END OP THE 
SPA COURSE, WITH A DESCRIPTION OP EACH FEATURE TESTED* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code’^ 


Percentage 
of Students 
Answering 
Correctly 


1 


Hay un mono an el nido. 


Verb "hay," noun phrase as 
subject, adverb 


6a 


86 


2 


iCuSnto peces cortan los 
nifios? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, transi- 
tive verb, noun phrase as 
subject 


?(5) 


69 


3 


Come el pan de la paloma. 


Use of "de" to show 
possession 


NSP(l) 


69 


U 


No es la cama de la 
mufieca. 


Negative pattern: noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, verb "ser," noun 
phrase as predicate nomi- 
native 


N(6) 


63 


5 


La mufieca toma cafi. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


96 


6 


iTiene el oso una mufieca? 


Interrogative pattern 
(yes-no question): verb 

transitive, noun phrase 
subject, noun phrase 
as direct object 


?(U) 


80 


7 


Los monos salen mucho. 


Noun phrase as subject, 
intransitive verb, adverb 


2a 


88 



* In items testing morphology, the feature tested is underlined. The items are listed 
in the order in which they were presented to students on the final test. The response 
alternatives were printed English sentences. 

"f The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the systen is 
given in a note at the end of Table 115, p. 218. 



TABLE 137 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


8 


Es el nido alto. 


Noun phrase as subject 
(unexpressed) , verb "ser," 
noun phrase as predicate 
nominative 


la(u) 


88 


9 


&De d6nde es el mono? 


Interrogative pattern 
(information question): 
interrogative phrase, 
verb "ser," no^m phrase 
as subject 


?(7) 


63 


10 


£Es espafiola su paloma? 


Interrogative pattern 
(yes-no question): verb 

"ser," predicate adjective 
noun phrase as subject 


?(8) 


73 


11 


£Por qu6 entra el mozo 
en la cocina? 


Interrogative pattern 
(information question): 
interrogative word, in- 
tramsitive verb, noim 
phrase as subject 


?(6) 


61 


12 


£De qui6n es el vino? 


"De qui^n" to convey 
"whose" 


nsp(6) 


73 


13 


La cocina es grande. 


Noun phrase as subject, 
verb "ser," predicate 
adjective 


lb 


90 


Ik 


Sale de la clase con el 
gato. 


Noun phrase as subject 
(unexpressed), intransi- 
tive verb, adverb 


2a(u) 


80 


15 


El pez no corta el pan. 


Negative pattern: noun 

phrase as subject, nega- 
tive particle, noun 
phrase as direct object 


N(5) 


88 


16 


El oso gordo come una 
paloma. 


Position of descriptive 
adjective following noun 


NSP(2) 


80 



3U9 



TABLE 137 continued 



Number 

of 

Item 


Item 


1 Description of 

Feature Tested 


Code5^ 


Percentage 
1 of Students 
1 Answering 
Correctly 


17 


Tienen dos peceras y 
un pez. 


Noun phrase as subject 
(unexpressed), transitive 
verb, noun phrase as 
direct object 


3a(u) 


57 


18 


No, el mozo no come queso. 


I Negative pattern; noun 
phrase as subject, nega- 
I tive particle, transitive 
verb, noun phrase as dir- 
ect object (in sentence 
1 following the utterance 
"No") 


N(ll) 


86 


19 


El pez quiere leer. 


Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 


5f 


84 


20 


Los que llevan camisas 
son hermanos . 


Nominalized definite arti- 
cle "los" modified by a 
phrase ("Los que" to con- 
vey "the ones who") 


NSP(7) 


61 


21 


Preferimos tocar. I 


Noun phrase as subject I 

(unexpressed), transitive I 
verb with verb infini- 
tive as complement | 


5f(u) 


88 


22 


La cantan al oso. 1 


Noun phrase as subject 
(unexpressed), noun phrase 
as direct object (pronoun) J 
transitive verb, noun 1 

phrase as indirect object I 


Ua* 1 


kh 


23 


El oso lo estudia. I 


Noun phrase as subject, I 

noun phrase as direct ob- 
ject (pronoun), transitive 
verb I 


3aa 1 


80 



The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table 115, P» 218. 
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TABLE 137 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage 
of Students 
Answering 
Correctly 


2k 


Tienen que eecuchar. 


Noun phrase as subject, 
(unexpressed), transitive 
verb, relator word, in- 
finitive of verb 


5g(u) 


69 


25 


El mono canta la canci6n 
al nifio. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator vord, noun phrase 
as indirect object 


Ua 


82 


26 


No escribe la historia en 
la escuela. 


Negative pattern: noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, transitive verb, 
noun phrase as direct ob- 
ject 


N(6)' 


53 


27 


No lo hace. 


Negative pattern: noun 

phrase as subject (unex- 
pressed), negative parti- 
cle, noun phrase as direct 
object (pronoun), transi- 
tive verb 


N(10) 


k6 


28 


£Quiere el gato enseflarlo? 


Interrogative pattern: 
transitive verb, noun 
phrase as subject, tran- 
sitive verb as complement, 
noun phrase as direct ob- 
ject (pronoun) 


?(13) 


ko 


29 


iQuieren cantar los 
elef antes? 


Interrogative pattern: 
transitive verb vith verb 
infinitive as complement, 
noun phrase as subject 


?(11) 


53 


30 


El mono tiene que estudiar. 


Noun phrase as subject, 
transitive verb, relator 
vord, infinitive of verb 


5g 


78 
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TABLE 137 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage 
Of Students 
Answering 
Correctly 


31 


El gato amarillo no come 
peces. 


Negative pattern: noun 

phrase as subject (modi- 
fied), negative particle, 
transitive verb, noun 
phrase as direct object 


N(U) 


62 


32 


iTiene qu8 bailar la 
paloma? 


Interrogative pattern: 
transitive verb, relator 
word, infinitive of verb, 
noun phrase as subject 


?(12) 


U6 


33 


Los osos compran mSs 
leche que los gatos. 


Comparison of inequality, 
("mis que" to convey 
"more than") 


NSP(6) 


63 



f The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table 115, p. 218. 



TABLE 138 



PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH WRITING 
VOCABULARY AND SPELLING ITEM TESTED AT THE END OP THE SPA 
COURSE, SHOWING THE CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 



Number 

of 

Item 


Item 


Percent 

Students/ 

Corre 


iage of 

Answering 

tctly 


Number 

of 

Item 


\ 1 

1 Item 


Percentage of 
Students/ Answering 
Correctly 






Vocabulary 


Spelling 






Vocabulary 


'' Spelling 


1 


Es una mesa. 


95 


89 


16 


I Es un mono. 


73 


67 


2 


Es una pifia. 


83 


59 


17 


I Es un pino. 


69 


4b 


3 


Es un muchacho 
(nif^o). 


95 


71 


1 


1 Es un oso. 


95 


95 


4 


Es un vaso. 


79 


67 


1 19 


1 Es una mufieca. 


83 


53 


5 


Es un pez. 


73 


55 


1 


Es una paloma. 


81 


79 


6 


Es UP cuchillo. 


71 


59 


21 


Es una mano. 


73 


67 


7 


Es una taza. 


57 


48 


22 


Es una casa. 


89 


89 


8 


Es una pecera. 


32 


10 


23 


Es una cuchara. 


59 


30 


9 


Es un nido. 


59 


34 


24 


Es mi hermano. 


69 


51 


10 


Es una ciona. 


75 


69 


25 


Es la cocina. 


67 


57 


11 


Es un dormitorio. 


73 


30 


26 


Es el mozo. 


85 












/y 


12 


Es un pozo. 


26 


20 


27 


Es el queso. 


53 


53 


13 


Es una pipa. 


97 


95 


28 


Es el pan. 


91 


89 


14 


Es una puerta 


32 


16 


29 


Es el cafS. 


89 


83 


15 


Es un plato. 


91 


87 


30 


Es el vino. 


79 


69 



* items are listed in the order in which they appeared. The written response 
required of the student was the underlined word(s) in the item. Words in parenthlses were 
acceptable substitutes. Words not underlined were provided in the answer booklet. 

1 Items were scored twice, once for the correctness of the vocabulary element and 
then again for the correctness of spelling. 
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TABLE 138 



Number 

of 

Item 


Item 


Percentage of I 
Students Answering I 
Correctly I 






Vocabulajry 


Spelling 1 


31 


Es la mamd. 


100 


100 1 


32 


Es la leche. 


97 


85 1 


33 


Es la sopa. 


91 


65 1 


34 


Es la came. 


57 


40 1 


35 


Es el 


81 


77 1 


36 


Es el papS. 


97 


95 1 


37 


Es grande. 


85 


83 1 


38 


Es gordo. 


81 


71 1 


39 


Es espafiol. 


91 


36 1 


40 


Es flaco. 


89 


85 1 


41 


Es alto. 


85 


81 1 


42 


Es pequefio. 


65 


32 1 


43 


Es bcijo. 


57 


55 1 


44 


Es guapo. 


79 


67 1 


45 


El tiene sed. 


6 


4 1 


46 


El sale. 


63 


61 1 


47 


El fuma. 


87 


85 1 


48 


El entra. 


71 J 


65 1 


49 


El duerme. 


71 


40 1 


50 


El come. 


75 


73 1 


51 


El toma cafS. 


81 


75 1 



continued 



Nmnber 

of 

Item 


Item 


Percentage of 
Students Answering 
Correctly 






Vocabulary 


Spelling 


52 


Es francos. 


59 


36 


53 


El tiene un 
vaso. 


75 


73 


54 


El tiene hambre. 


8 


6 


55 


El corta el pan. 


40 


30 


56 


El pone el vaso 
en la mesa. 


55 


48 


57 


Ndmero uno. 


95 


91 


58 


iQuS es? 


85 


85 


59 


Hay leche. 


30 


30 


60 


iCuAntos son? 


61 


44 


61 


Quiere otro vaso 


40 


32 


62 


£De quiSn es? 


4 


4 


63 


En la casa. 


83 


81 


64 


Es mi maroA. 


91 


85 


65 


iQuS hace? 


28 


26 


66 


Con el oso. 


55 


55 


67 


Yo tengo un vaso 


73 


73 


68 


No, pero es 
grande. 


44 


40 


69 


Nfimero seis. 


87 


69 
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TABLE 138 continued 



Number 

•f 

Item 


Item 


Percentage of 
Students^ Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage of 
Students/ Answering 
Correctly 




Vocabulary 


Spelling 




Vocabulary 


Spelling 


70 


Es su mono. 


67 


67 


89 


Es una persona. 


95 


87 


71 


El tiene suefio. 


4 


2 


90 


Es una carta. 


38 


38 


72 


Ndmero dos. 


97 


93 


91 


Es un hombre 


69 


57 












(seflor). 






73 


Gracias. 


85 


61 










74 


Ntlmero tres. 


97 


87 


92 


Es un pato. 


36 


34 


75 


Mamd o_ papd. 


93 


93 


93 


Es una pera. 


53 


51 


76 


iCudndo come 


24 


24 


94 


Es un alumno. 


75 


65 




usted? 














77 


Porque es Felipe. 


67 


59 


95 


Es un pollito. 


28 


22 


78 


Quiero mucho. 


75 


75 


96 


Es una pluma. 


75 


71 


79 


Ndmero cuatro. 


87 


63 


97 


Es un elefemte. 


95 


67 


80 


Hamd ^ papN. 


79 


79 


98 


Es un hue VO. 


34 


10 


81 


Es de Espafia. 


46 


26 


99 


Es una escuela. 


46 


34 


82 


£D6nde come? 


40 


40 


100 


Es un abrigo. 


65 


55 


83 


Ndmero cinco. 


83 


81 


101 


Es un amigo. 


83 


81 


84 


Es esta tarde. 


36 


32 


102 


Es una blusa. 


95 


83 


85 


£Qu8 son? 


44 


44 


103 


Es un minuto. 


69 


42 


36 


Es de Francia. 


53 


30 


104 


Es un animal. 


97 


93 


87 


iPor quS? 


65 


61 


105 


Es una camisa. 


73 


71 


88 


Sale conmigo. 


51 


44 


106 


Es un mel6n. 


89 


75 



^ Items were scored twice, once for the correctness of the vocabulary element and 
then again for the correctness of spelling. 
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TABLE 138 continued 



Number 

of 

Item 


1 

Item 


Percentage of 
Students Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage of 
Students Answering 
Correctly 


Vocabulary 


Spelling 




Vocabulary 


Spelling 


107 


Es una fruta. 


91 


48 1 


126 


Es la historia. 


87 


73 


108 


Es una clase. 


95 


77 


127 


Es negro. 


97 


91 


109 


Es una muchacha 


91 


73 


128 


Es bianco. 


91 


83 




(nifia). 














110 


Es una falda. 


38 


36 


129 


Es necesario. 


51 


6 


111 


Es un piano. 


89 


81 


130 


Es azul. 


87 


85 


112 


Es un libro. 


75 


63 


131 


Es fdcil. 


40 


34 


113 


Es una mujer 


59 


46 


132 


Es verde. 


61 


55 




(senora). 














114 


Es un zapato. 


67 


55 


133 


Es amarillo. 


87 


63 


115 


Es una familia. 


73 


28 


134 


Es simpdtico. 


75 


65 


116 


Es una guitarra. 


85 


53 


135 


Es fuerte. 


57 


48 


117 


Es un gato. 


89 


85 


136 


Es dSbil. 


36 


26 


118 


Es una hora. 


53 


48 


137 


El escribe. 


48 


38 


119 


Es una campana. 


51 


38 


138 


El lee. 


61 


61 


120 


Es un segundo. 


38 


24 


139 


El lleva un 


59 


40 












abrigo. 






121 


Es mi hijo. 


67 


63 










122 


Es mi profesor 


87 


67 


140 


El escucha. 


34 


32 




(profesoraET 














123 


Es el papel. 


75 


75 


141 


El toca el piano 


61 


59 


124 


Es la mOsica. 


95 


85 


142 


Quiero comer. 


26 


26 


125 


Es el dinero. 


67 


57 


143 


El llega. 


30 


28 



f 
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TABLE 138 continued 



Number 

of 

Item 


Item 


Percentage of I 
Students' Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage of 
Students' Answering 
Correctly 




Vocabulary Spelling 




Vocabulary 


Spelling 


144 


El prefiere 


55 


16 


159 


Nosotros soraos 


2 


2 




bailar. 








hermanos . 






145 


Yo creo que es 


24 


22 


160 


Es medio queso. 


55 


51 




Felipe . 














146 


El ensefla el 


59 


32 


161 


iCuAnto vale? 


18 


10 




espafiol. 














147 


El ScQ>e muchas 


18 


18 


162 


Canta bien. 


69 


67 




cosas . 














148 


El aprende el 


32 


28 


163 


Quiero mds. 


53 


46 




espafiol. 














149 


El dice muchas 


44 


40 


164 


Yo ten^o que 


6 


4 




cosas . 








escribir. 






150 


Yo estudio. 


53 


44 


165 


Estudio 


69 


53 












inglSs . 






151 


El puede salir. 


12 


12 










152 


Yo sS . 


18 


18 


166 


Llega tarde. 


46 


40 


153 


Son los 


69 


48 


167 


Sale temprano. 


40 


36 




pantalones . 














154 


El quiere el 


38 


30 


168 


Quiero comprar. 


18 


12 




libro. 














155 


Buenas tardes. 


63 


28 


169 


NCimero trescien- 


71 


42 












tos. 


• 




156 


Adi6s . 


87 


79 










157 


De nada. 


59 


46 


170 


Si, con mucho 


28 


28 












gusto. 






158 


El tiene frlo. 


6 


6 











^ Items were scored twice, once for the correctness of the vocabulary element and 
then again for the correctness of spelling. 
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TABLE 138 continued 



Niunber 

of 

Item 



203 

204 

205 

206 



Item 



NChnero diez. 

iQuilnee son 
estas muchachas? 

Nlimero cuarenta . 

Hay trea cosas , 



Percentage of 

Students^ Answering! Number] 
Correctly I of 

Item 



Item 



Vocabulary 



83 

10 

40 

55 



Spelling 



73 

10 

12 

51 



207 Ndmero nueye. 

208 I EstS bien* 



209 



^Es «1? 



Percentage of 
Students' Answering 
Correctly 



Vocabulary 



85 

10 

44 



Spelling 



42 

10 

42 



• Items were scored twice, once for the correctness of the vocabulary element and 
then again for the correctness of spelling, ^ ej.emenx; ana 
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TABLE 139 

PERCENTAGE OP STUDENTS CORRECTLY ANSWERING EACH WRITING GRAMMAR 
ITEM TESTED AT THE END OF THE SPA COURSE, SHOWING RESULTS OF 
SCORING ON DISCRETE ELEMENTS AND ON ENTIRE UTTERANCE* 



Number 

of 


Item 


Description of 
Feature Tested 


Code / 


Percentage of Students 
Answering Correctly 


luem 


i 






Discrete 

Element 


Entire 

Utterance 


1 


Un gato es un animal. 


Noun phrase as subject, 
verb "ser," noun phrase 
as predicate nominative 


la 


87 


71 


2 


Es la una. 


Definite article plus 
number in reference to 
telling time 


NSP(U) 


57 


51 


3 


Hi casa es pequeha. 


Noun phrase as subject, 
verb "ser," predicate 
adjective 


lb 


91 


85 


k 


Sancho compra un 
libro. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


51 


k6 


5 


Quiero aprender el 
espahol. 


Definite article with 
name of language 


NSP(9) 


10 


2 


6 


No lo tengo. 


Negative pattern: noun 

phrase as subject (unex» 
pressed), negative part- 
icle, noun phrase as 
direct object (pronoun), 
transitive verb 


N(10) 


18 


Ik 


7 


No, es el oso del 
muchacho. 


Contraction "de" + "el" 
to "del" 


NSP(lO) 


6 


6 



* Items axe listed in the order in which they were presented to students on the final 
test. In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to be completely free of error 
for the response to be marked correct. A complete listing of the elements required in each 
student response is presented in Table 129 » p. 302- 

^ The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table 115, p. 218. 
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TABLE 139 continued 



Number 

of 


Item 


Description of 
Feature Tested 


Code 


Percentage of Students 
Answering Correctly 


Item 


Discrete 

Element 


Entire 

Utterance 


8 


Si, Sancho lo lleva. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb 


3aa 


22 


18 


9 


iTiene Marla un 
abrigo azul? 


Position of descriptive 
adjective following noun 


NSP(2) 


36 


10 


10 


(La mufieca) duerme en 
la cama. 


Noun phrase as subject, 
intransitive verb, adverb 


2a 


k6 


Uk 


11 


Si, las que comen 
muchos son gordas. 


Nominalized definite arti- 
cle "las" modified by a 
phrase ("las que" to con- 
vey "the ones who") 


NSP(7) 


k 


k 


12 


Sancho tlene mSs 
dinero que Marla 


Comparison of inequality, 
"mas" plus "que" to con- 
vey "more than" 


NSP(8) 


3U 


3U 


13 


El profesor ensefia una 
canclon a los alumnos. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator word, noun phrase 
as indirect object 


Ua 


3U 


26 


lU 


No, la mamS lee al 
niflo. 


Contraction of "a" + "el" 
to "al" 


NSP(ll) 


2 


2 


15 


(Los muchachos) 
quieren bailar. 


Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 


5f 


38 


VO 

H 


l6 


Tengo que estudiar. 


Noun phrase as subject, 
transitive verb, relator 
word, infinitive of verb 


5g 


10 


10 


17 


Hay cinco vasos en 
la mesa. 


Verb "hay," noun phrase 
as subject, adverb 


6a 


57 


53 


18 


Es el oso de Sancho. 


Use of "de" to indicate 
possession 


NSP(l) 


30 


2k 



I 
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TABLE 139 continued 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code/ 


Percentage of Students 
Answering Correctly 


Discrete 

Element 


Entire 

Utterance 


19 


(No,) Sancho no es 
simpAtico. 


Negative pattern : noiui 

phrase as subject, nega- 
tive particle, verb "ser," 
predicate adjective (in 
sentence following the ut- 
terance "No") 


N(ll) 


30 


28 


20 


Si* (el papA) lo 
enseha a su hi jo. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb, relator word, noun 
phrase as indirect object 


ha* 


8 


8 


21 


iEscucha Maria la 
mOsica? 


Interrogative pattern 
(yes-no question): tran- 

sitive verb, noun phrase 
as subject, notui phrase as 
direct object 


?(M 


12 


12 


22 


£De quiln es el oso? 


De + qui^n to express 
"whose" 


NSP(6) 


8 


U 


23 


dCompra Maria una 
muneca grande? 


Interrogative pattern 
(yes-no question): tran- 

sitive verb, noun phrase 
as subject, noun phrase as 
direct object (modified) 


?( 4 ') 


16 


l 4 


2U 


iDonde canta Sancho? 


Interrogative pattern (in- 
formation question): in- 

terrogative word, intran- 
sitive verb, noun phrase 
as subject 


?(6) 


VO 

CVI 


18 


25 


£Es gremde su casa? 

1 


Interrogative pattern 
(yes-no question): verb 

"ser," predicate adjective, 
noun phrase as subject 


?(8) 


10 


10 



^ The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to all three courses. An explanation of the system is 
given in a note at the end of Table II5, p. 218. 
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TABLE 139 continued 



Number 




Description of 


a _ 1 


Percentage of Students 
Answering Correctly 


of 

Item 


Item 


Feature Tested 


Code 


Discrete 

Element 


Entire 

Utterance 


26 


£Por qu6 no cone 
Marla? 


Negative-interrogative 
pattern: interrogative 

word, negative particle, 
intransitive verb, noun 
phrase as subject 


N(12) 


38 


36 


27 


^QuS lleva Marla? 


Interrogative pattern 
(information question): 
interrogative word, tran- 
sitive verb, noun phrase 
as subject 


?( 5 ) 


38 


38 

V 


28 


^De d6nde es Marla? 


Interrogative pattern 
(information question): 
interrogative phrase, 
verb "ser," noun phrase 
as subject 


til) 


20 


18 


29 


iCantan las mujeres? 


Interrogative pattern 
(yes-no question): in- 

transitive verb, noun 
phrase as subject 


?(10) 


18 


12 


30 


Si, soy fuerte. 


Irregular form, verb 
”ser,” first person singu- 
leur, present tense 


Mvi(5) 


20 


20 


31 


(Yo) lo s6. 


Irreguleur form, verb 
"saber,” first person 
singular, present tense 


Mvi(2) 


8 


2 


32 


(No,) es el nifi£. 


Agreement masculine singu- 
lar article + masculine 
singuleur noun ending in 0 


Mn(l) 


32 


32 


33 


(No,) nuestra 
muchacha canta bien. 


Agreement first person 
plural feminine possessive 
adjective + feminine sing- 
ular noun 


Ma(9) 


12 


10 


3U 


Los nifios toman 
leche . 


Regular form, "ar" verb, 
3rd person plural, present 
tense 


Mvr(5) 

1 


2U 


16 



363 



TABLE 139 continued 



Number 


Item 


Description of 
Feature Tested 




Percentage of Students 
Ansv*ring Correctly 


of 

Item 


wOCLCf 


Discrete 

Element 


Entire 

Utterance 


35 


(Si.) (Usted) sale 
temprano . 


Regular form, verb 
"salir," 3rd person singu- 
lar, present tense 


Mvr(7) 


8 


8 


36 


(Si.) (Yo) canto 
bien. 


Regular form, "ar" verb, 
1st person singular, pre- 
sent tense 


Mvr(l) 


26 


22 


37 

( 


(SI,) (Marla) las 
tiene . 

1 


Feminine plural direct ob- 
ject pronoun 


Mp(4) 


10 


10 


38 1 


1 (Marla) tiene dos 
blusas verdes . 


Agreement of feminine 
plural noun + adjective 
with "es" ending 


Ma(5) 


l4 


l4 


39 


(Si,) son sus libros. 


3rd person plural posses- 
sive adjective with plural 
noun 


Ma(l2) 


18 


18 


40 


(La pipa) es amarill£. 


Agreement of feminine 
singular noun (+ verb 
"ser") + feminine singu- 
lar adjective 


Ma(3) 


22 


20 


Ul 


(No,) Sancho toma 
leche . 


Regular form, "ar" verb, 
third person singular, 
present tense 


Mvr(3) 


40 


34 


U2 


(Si,) llegamos a las 
ocho. 


Regular form, "ar" verb, 
first person plural, pre- 
sent tense 


Mvr(4) 


4 


4 


43 


(Si,) (Sancho) lo 
tiene. 


Masculine singular direct 
object pronoun 


Mp(2) 


24 


24 


44 


(Yo) digo adi6s. 


Irregular form, verb 
"decir," first person 
singular, present tense 


Mvi(3) 


8 


8 



i The coding system was designed as an aid in referring to identical feat\ires across 
tests. The coding system applies to all three courses. An explanation of the system is' 
given in a note at the end of Table II3, p. 218. 
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TABLE 139 continued 



Percentage of Students 
Answering Correctly 



Number 

of 

Item 



Item 



Description of 
Feature Tested 



Code 



Discrete Entire 
Element Utterance 




U5 



(No,) Sancho es un 
nifio. 



Irregular form, verb 
"ser," third person singu- 
lar, present tense 



Mvi(7) 



75 



63 



U 6 



Los hombres son 
altos . 



Irregular form, verb 
"ser," third person plural 
present tense 



Mvi(9) 



U 6 



30 



U 7 



(El) (oso) es 
amarillo . 



U 8 



No, son las nifia^. 



Agreement of masculine 
singular noun (+ verb 
"ser") + masculine singu- 
lar adjective 

Agreement plural article 
-f plural noun 



Mad) 



Mn(U) 



53 



26 



U6 



2h 



U9 



(Sancho) tiene dos 
(camisas) blancas. 



Agreement of feminine 
plural noun 'i- feminine 
plural adjective 



Ma(U) 



2U 



2U 
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TABLE lUO 

PERCENTAGE OF STUDENTS CORRECTLY ANSWERING EACH WRITING GRAMMAR TRANSFER 
ITEM TESTED AT THE END OF THE SPA COURSE, SHOWING RESULTS OF 
SCORING ON DISCRETE EliEMENTS AND ON ENTIRE UTTERANCE* 



Number 

of 

Item 


Item 


Description of 
Feature Tested 


Code 


Percentage of Students 
Answering Correctly 


Discrete 

Element 


Entire 

Utterance 


1 


Un mozo es una persona 


Noun phrase as subject, 
verb "ser,” noun phrase 
as predicate nominative 


la 


95 


51 


2 


Son las tres. 


Definite article plus num- 
ber in reference to tell- 
ing time 


NSP(U) 


36 


lU 


3 


La mesa es negra. 


Noun phrase as subject, 
verb "ser," predicate ad- 
jective 


lb 


93 


36 


U 


(El profesor) canta 
una canci6n espafiola 


Noxm phrase as subject, 
transitive verb, noun 
phrase as direct object 


3a 


26 


2 


5 


Enseho el francos. 


Definite article with 
name of language 


NSP(9) 


6 


k 


6 


No, no lo tomamos. 


Negative pattern: noun 

phrase as subject (unex- 
pressed), noun phrase as 
direct object (pronoun), 
transitive verb 


n(io) 


12 


2 


7 


(Si,) es la guitarra 
del hombre. 


Contraction of "de" + ”el" 
to "del" 


NSP(IO) 


6 


U 



* Items are listed in the order in which they were presented to students on the final 
test* In scoring on discrete elements, only errors on the point being tested caused loss of 
credit. In scoring on the entire utterance, the utterance had to he completely free of error 
for the response to he marked correct. A complete listing of the elements required in each 
student response is presented in Table 131 • P* 315* 

^ The coding system was designed as an aid in referring to id"''tic8d features across 
tests. The coding system applies to all three courses. An explemation of the system is 
given in a note at the end of Table 115* P* 2l8. 
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TABLE 1^0 continued 



Rum'ber 


Item 


Description of 
Feature Tested 




Percentage of Students 
Answering Correctly 


or 

Item 


uocie 


Discrete 

Element 


Entire 

Utterance 


8 


(El alumno) lo toca. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb 


3aa 


lU 


8 


9 


Puma una pipa negra. 


Position of descriptive 
adjective following verb 


NSP(2) 


U6 


16 


10 


Sale de la eacuela. 


Noiin phrase as subject, 
intransitive verb, adverb 


2a 


36 


22 


11 


Las que comen mucho 
son gordas. 


Nominalized definite arti- 
cle "las" modified by a 
phrase ("las que" to con- 
vey "the ones who") 


NSP(7) 


k 


k 


12 


El elefante es mis 
fuerte que el oso. 


Comparison of inequality 
("mis" + "que" to convey 
"more than") 


NSP(8) 


2k 


20 


13 


(La nifia) lee la 
carta al profesor. 


Noun phrase as subject, 
transitive verb, noun 
phrase as direct object, 
relator word, noun phrase 
as indirect object 


Ua 


Ik 


2 


lU 


El muchacho escribe 
al hombre. 


Contraction of "a" + "el" 
to "al" 


NSP(ll) 


2 


2 


15 


No, prefiero cantar. 


Noun phrase as subject, 
transitive verb with verb 
infinitive as complement 


5f 


10 


8 


16 


(Porque) tengo que 
comer. 


Noun phrase as subject, 
transitive verb, relator 
word, infinitive of verb 


5g 


k 


k 


17 


Hay dos alumnos en la 
clase. 


Verb "hsy," noim phrase 
as subject, adverb 


6a 


51 


51 


10 


Si, es la mufieca de 
la nifia. 


Use of "de" to indicate 
possession 


NSP(l) 


UO 


30 



. 1 ^ 
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TABLE lUO continued 



Number 

of 


! Item 


Description of 
Feature Tested 


CodeT^ 


Percentage of Students 
Answering Correctly 


Item 




Discrete 

Element 


Entire 

Utterance 


19 


(No,) el oso no es 
flaco. 


Negative pattern : noun 

phrase as subject, nega- 
tive particle, verb "ser," 
predicate adjective (in 
sentence following ut- 
terance "No") 


N(ll) 


uo 


38 


20 


Lo ensefia a su pap&. 


Noun phrase as subject, 
noun phrase as direct ob- 
ject (pronoun), transitive 
verb, relator word, noun i 
phrase as indirect object 


Ua' 


10 


10 


21 


iCome Susana el pan? 


Interrogative pattern 
(yes-no question): tran- 

sitive verb, noun phrase 
subject, noun phrase as 
direct object 


?(U) 


16 


10 


22 


iDe donde es Juan? 


Use of "de" preceding 
"donde" to indicate ori- 
gin 


NSP(12) 


32 


12 


23 


iTiene Sancho un mono 
negro? 


Interrogative pattern 
(yes-no question): tran- 

sitive verb, noun phrase 
as subject, noun phrase 
as direct object (modi- 
fied) 


T(U') 


20 


20 


2k 


£Por quS no toma 
us ted leche? 


Negative-interrogative 
pattern: interrogative 

word, negative particle, 
transitive verb, noun 
phrase as subject, noun 
phrase as direct object 


N(12) 


Ih 


10 



7^ The coding system was designed as an aid in referring to identical features across 
tests. The coding system applies to aJ.1 three courses. An explanation of the system is 
given in a note at the end of Table 115, p. 218. 
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TABLE lUO continued 



T 



Percentage of Students 
Answering Correctly 



Number 

of 

Item 



Item 



Description of 
Feature Tested 



Code 



Discrete Entire 
Element Utterance 



25 



iEs fuerte el gato? 



Interrogative pattern: 
(yes-no question): verb 

"ser," predicate adjec- 
tive, noun phrase as sub- 
ject 



?( 8 ) 



lU 



10 



26 



iCuNndo come la mujer? 



Interrogative pattern 
(information question): 
interrogative word, in- 
transitive verb, noun 
phrase as subject 



?( 6 ) 



18 



16 



27 



iQu8 come la niha? 



Interrogative pattern 
(information question): 
interrogative word, tran- 
sitive verb, noun phrase 
as subject 



?(5) 



26 



22 



28 



iDe qui8n es la 
guitarra? 



29 



iAprenden los 
alumnoa? 



Int err ogat ive pattern ? ( 7 ) 

(infomation question): 
interrogative phrase, verb 
"uer," noun phrase as sub- 
ject 

Interrogative pattern ?(10) 

(yes-no): intransitive 

verb, noun phrase as sub- 
ject 



h 



12 



U 



10 






.m"" 















APPENDIX C 

UAE COURSE OBJECTIVES AND 
STUDENT PERFORMANCE DATA 



Ob.iectlves froa Publlahed Course 



Material in this section consists of excerpts from the teacher's guide 
accompanying Ihia aventura espafiola .^ 

The Pasadena City Schools are pleased to present Ifaa aventura espafiola i 
a series of Educational Television lessons In Spanish via the audlo-llngual method, 
designed for elementary children. 

It Is hoped that students gradually will be able to comprehend and utilize 
the spoken word. The Instruct loneJ. strategy Is based on four teaching tactics: 

To develop the ability to leatm a second language . 

This ability Is Inherent In young children. Mimicry Is capitalized 
upon at this stage of development. Emphasis Is placed on achieving cor- 
rect pronunciation. 

To comprehend and appreciate a second language. 

The children are given an early and continuous contact with the 
Spanish language, stressing the develoimient of accurate and critical 
learning skills, thus enabling them to develop conversational facility. 

To develop an awareness of the Influence and Impact of Spanish culture . 

Spanish Is all about us— Spanish names of cities, streets, schools, 
well as music, art, and architecture, are part of our everyday living, 
not to minimize the large numbers of Spanish-speaking American citizens. 

To develop an understanding of and respect for the Spanish-speaking 
peoples of the world . 

As nations become more closely related through transportation and 
communication developments, an understanding of language can aid In the 
appreciation of the culture and history of the people of these nations. 






Material In this section Is quoted from Teacher's Guide Book I for 
Una aventura espafiola. Pasadena City Schools, (ueath de Bochemont Corporation, 
1963 )• 'Ey permission of the publisher. 
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Course Author *s St atement Supplementing Published Course Ob.lectives 



The material presented below was obtained from the course author at the 
beginning of Project D-177 to supplement the statement of objectives in the 
teacher s guide accompanying Una aventura espafiola . 

^ 4 aventura espafiola” is a two-year program consisting of 180 lessons 

desipied to teach the students progressively to understand Spanish, speak 
Spanish, and to begin to read that which they can speak. 



In the first 90 lessons, the student is introduced to listening compre- 
hension Md speaking. Beginning reading does not become an objective until 
^ssons 91-180. With regard to listening comprehension and speaking, the stu- 
dents are exposed to many things during the first 90 lessons which they are not 

esqpected to MSter until they receive additional exposure and practice in 
lessons yl'^loO. 



LISmiHG COMPRKHENSIOM OBJECTIVES 

In the first 90 lessons, we are mainly concerned with proficiency in 

emphasis is primarily on getting the student accus- 
tomed to hearing Spanish sounds so that he can listen to them with ease and 
pleasure, gradually developing the ability to understand the meaning of the 
^Mish words, and Idiomatic expressions, when spoken by a native speaker at a 
Mr^ rate of s^ed. l^on completion of 90 units, the student should be able 

ability to con^rehend the lexical units and idiomatic expres- 

among several pictures the one which best 
CMilv and expressions which cannot be 

En^ish alternatives the one which best agrees with the Spanish utterance 
e hears. However, it should be pointed out that the use of ENGLISH in the in- 

progr^ is minimal and, therefore, may cause some decrement in per- 
formance when used in testing. ^ 

completion of Lessons 9I-I8O, when hearing Spanish spoken by a 

“ normal rate of speed, students are expected to be able to 
^ recognition of syntactical signals through comprehension of 
representing many different syntax patterns; and (2) recog- 
in SpLlsh!*^ differences in meaning caused by specific morphological changes 



SPEAKING OBJECTIVES 

objectives for the first 90 lessons are concerned with mastery 
«L number of Spanish expressions which the student should be able to 

pleasure in specific contexts. Emphasis at this stage is on 
enjoyment through control of a limited amount of the 
fluency ^ «**adual and progressive development of conversational 



The student should be able to demonstrate his control 
expressions by making responses to a Spanish speaker which 
to the situation and understandable to a native speaker of 



of a limited number of 
are both appropriate 
Spanish. 
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The student should also be able to initiate certain utterances in Spanish, 

In accordance with directions given him in English, he should be able to pro- 
duce the appropriate Spanish utterance which a native speaker of Spanish can 
understand. The utterances which he can control in making responses or initiat- 
ing conversational exchanges are listed in the "List of Expressions for the 
Speaking Expression Test (Units 1-90)," 

In addition to being able to make himself understood by a native speaker of 
Spanish, the ultimate goal in regard to pronxmciation is near-native control of 
the Spanish sound system. At the end of 90 lessons, some students are expected 
to achieve this goal. Those aspects of the Spanish sound system which the student 
should control are described in the "List of Spanish Sounds to be Tested in 
Units 1-90," 

At the end of the first 90 units, the student will have learned, by heart, 

14 songs and U verses (see attached list). Given the first line of any of the 
songs or verses he should be able to say aloud, in Spanish, all of the remaining 
lines. Students will also be exposed to some basic language patterns found in 
stories (for exanqole: ^D6nde est& usted?, Lo vi -, etc,, from the story, 

"El pollito," Unit 59 » and others). 

In Lessons 91-180, emphasis on control of morphelogical forms and grammatical 
structures, in speaking, begins. At the end of 180 lessens the student can be ex- 
pected to demonstrate control of a wide variety of fonna and patterns both in 
initiating Spanish utterances or in responding to a Spanish speaker. 

It cannot be emphasized too strongly that UAE is a cooperative endeavor be- 
tween the TV teacher and the classroom teacher. In-service training in utiliza- 
tion of the materials prior to the initiation of the program and proper use by the 
classroom teacher of the teacher's guide, recordings, pupil activity books, etc,, 
in preparatory and follow-up activities, are essential for the achievement of the 
course objectives. 



SONGS AND VERSES 
(Units 1-90) 

In testing the students' knowledge of the songs and verses, it is recommended 
that a group test be administered and the evaluation be based on group performance. 
Individual testing of songs may produce an awkward situation for the student and, 
therefore, inhibit his performance. 



Item 


Unit 


1, 


3 


2, 


5 


3. 


5 


k. 


10 


5. 


17 


6 , 


18 


7. 


32 


8, 


37 


9. 


hi 


10, 


US 


11, 


59 


12, 


6l 



Songs 

Ihio, dos y tres 
£Qu 4 es esto? 

La pelota, 

Dos y dos 
Bingo 

San Severino 
£Qu8 comer? 

Me gustan todas 
Juan Molinero 
Fray Felipe 

Vengan a ver mi chacra 
El pat it o color de cafS 
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TABLE lUl 



PERCENTAGE OP STUDENTS CORRECTLY ANSWERING EACH LISTENING COMPREHENSION 
VOCABULARY ITEM TESTED AT END OP COURSE IN UAE CLASSES, SHOWING THE 
CONTEXT IN WHICH EACH RESPONSE WAS SOUGHT* 



Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


Number 

of 

Item 


Item 


Percentage 
of Students 
Answering 
Correctly 


1 


Buenas noches. 


66 1 


16 


Es un payaso. 


81 


2 


£s un soldado. 


69 


17 


Buenos dlas. 


92 










muchachos . 




3 


El padre estd aqul. 


96 














18 


Esta es una casa. 


70 


k 


Tenemos una bandera. 


95 














19 


£Qu8 hora es? 


8U 


5 


El reloj es pesado. 


63 














20 


Es el tiempo de las 


68 


6 


Son los brazos. 


66 




brujas. 




7 


El carpintero hace 


80 


21 


Es una manzana. 


8l 




asl. 
















22 


Es un papel. 


7U 


8 


Es la una y media. 


8l 














23 


Cierro la puerta. 


6k 


9 


Es una pelota. 


86 














2k 


Aqul estd el 


90 


10 


Es la cabeza. 


8l 




calendario . 




11 


Me peino es pelo. 


6k 


25 


La madre es baja. 


' 5k 


12 


Es una chacra. 


7U 


26 


Son los dedos. 


50 


13 


Los pies son para 


71 


27 


Duermo en la cama. 


73 




caminar. 
















28 


La casa tiene un 


6k 


lU 


Es el sombrero del 


91 




cuarto. 






payaso . 
















29 


La abuelita estA en 


ki 


15 


Como naranjas. 


78 




el jardln. 





* Vocabulary items are underlined. The Spanish utterances are listed in the order 
in which they were presented to students on the final test. The required student 
response was a brief Spanish utterance. Only the underlined words were scored. 



TABLE lUl Continued 



Number 

of 

Item 




Item 


Percentage 
of Students 
Answering 
Correctly 




Number 

of 

Item 


■ ^ 

Item 


Percentage 
of Students 
Answering 
Correctly 


30 


Como legumbres. 


81 




47 


La bandera tiene 


33 












listas. 




31 


Buenos dias. maestra. 


93 


















48 


Es un Idpiz. 


6l 


32 


Son ndmeros. 


90 


















49 


Es la medianoche. 


39 


33 


La bandera tiene 


33 












estrellas. 






50 


El payaso estd 


70 












contento . 




3h 


Es un arbolito. 


6l 


















51 


Es tinta. 


47 


35 


Son calabazas. 


64 


















52 


El primo es guapo. 


56 


36 


El ranchero tiene un 


74 












perro. 






53 


Me levanto. 


61 


37 


La lavandera hace asl. 


64 




54 


Bailo en la sala. 


55 


38 


Es la una. 


87 




55 


Tiene dos ojos. 


91 


39 


Es una mesa. 


91 




56 


El abuelo es 


• 62 












simpdtico. 




UO 


Es la cara. 


24 


















57 


Voy caminando. 


59 


Ul 


Son gatos. 


90 


















58 


La casa tiene una 


78 


U2 


Tenemos una pizarra. 


63 






cocina. 




U3 


Las piernas son para 


43 




59 


Es un pizarr6n. 


11 




caminar. 
















53 




6o 


Es una recdmara. 


9 


UU 


Estd triste. 




















6l 


Tenemos una 


76 


U5 


La casa tiene un 


56 






ventana. 






cuarto de bado. 




















62 


Es un burro. 


97 


U6 


Como frutas. 


97 












Ml 
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TABLE lUl Continued 



Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


It«DI 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


63 


Tenemos una 


87 




78 


El tlo es alto. 


8U 




puerta. 






79 


iBate el 


88 


6k 


El reloj tiene 
un pajarito. 


60 






chocolate ! 












80 


Son las manos. 


87 


65 


La cabeza tiene 
dientes. 


76 




81 


Habla un ranchero. 


92 


66 


Va a escribir. 


59 




82 


Me siento. 


73 


67 


El zapatero hace 


70 




83 


Es una boca. 


69 




asi. 






8U 


Como muchas fresas. 


8U 


68 


Es la puerta 
pequefla. 


86 




85 


Carlos va a la 
escuela. 


76 


69 


Vemos los libros. 


86 




86 


Tengo un cuerpo 


ko 


70 


Tiene dos cejas. 


39 






humano. 




71 


Leo en la sala. 


63 




87 


Esta es una 
persona. 


k2 


72 


Como muchas frutas. 


79 




88 


Como cerezas. 


79 


73 


Es un chango. 


86 




89 


Me lavo. 


k9 


7U 


Duermo en la alcoba. 


69 




90 


Buenas tardes. 


97 


75 


Tiene dos orejas. 


33 






sefiorita. 




76 


cCuSntos hay en la 


95 




91 


Es un vaquero. 


65 




clase? 






92 


Es helado. 


32 


77 


Es el pelo. 


60 




93 


Es chocolate. 


96 
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TABLE lUl Continued 



Number 




Percentage 




Number 




Percentage 


of 


Item 


of Students 




of 


Item 


of Students 


Item 




Answering 




Item 




Answering 






Correctly 








Correctly 


158 


La casa tiene 
dos pisos. 


6 k 




174 


&C 6 mo te llamas? 
iCuAles son estos 


58 








175 


55 


159 


Es el numero siete. 


87 






nlimeros? 




l 60 


&Qu$ vemos en la 


32 




176 


Es una manzana 


89 




clase? 








deliciosa. 




l 6 l 


Es rojo. 


75 




177 


Es el ntjmero tres. 


97 


162 


Aqul est$ el 


53 




178 


Es lunes. 


82 




calendario . 






179 


Son padres. 


71 


163 


&QuS pasa? 


53 




180 


iQuS dia fue ayer? 


39 


16U 


Es jueves. 


65 




181 


82 








Voy a contar una 


165 


TambiSn estoy muy 
bien. 


U 6 






historia. 


36 










182 


Vamos a todos los 


166 


Es un minuto. 


81 






cuartos. 




167 


Es el ndmero quince. 


90 




183 


iCuAl es este 


63 












nfimero? 




168 


IQuS tarde! 


6 k 




184 


Es el nfimero 


83 


169 


Carlos 2^ a la 


65 






catorce . 






escuela. 






185 


El padre es moreno. 


52 


170 


Hay unos libros 
azules. 


48 




186 


El padre vive en la 


75 












casa. 




171 


Es sSbado. 


77 




187 


Es espatiola. 


92 


172 


Es el nfamero diez. 


95 




188 


Es el nfimero seis. 


93 


173 


Voy a contar un 
cuento. 


43 




189 


cComo es el libro? 


14 




* 



] 
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219 


Son las cinco 


63 




235 


Es el verano. 


21 




de la tarde. 




















236 


El le6n tiene 


33 


220 


Es el libro 


6l 






garras . 






nuevo . 




















237 


Aqui tenemos 


81 


221 


&QuS dla es hoy? 


6o 






una estufa. 




222 


Son las nueve de 


58 




238 


El elefante tiene 


5h 




la mafiana. 








patas muy pesadas. 




223 


Faltan veinte minutos 


k6 




239 


Es un oso pequeflo. 


h2 




para las seis. 




















2U0 


Es una bolsa. 


h5 


22k 


Es la pelota redonda. 


73 


















2hl 


Es^iiii zorro. 


62 


225 


Es el ndmero doce. 


89 


















2h2 


Es una pera. 


83 


226 


Vaya a la silla. 


hi 


















2h3 


La muchacha lleva 


37 


227 


Me gustan todas. 


63 






un vestido. 




228 


Es un tigre. 


85 




2hh 


Tiene un pescuezo 


hh 












largo. 




229 


Come cereal. 


82 


















2h5 


El primo juega. 


29 


230 


Es un cuchillo. 


hS 


















2h6 


Tiene manchas. 


30 


231 


Es un durazno. 


57 


















2h7 


Es una blusa. 


80 


232 


Es una Idmpara. 


90 


















2hd 


Es el sombrero 


66 


233 


Es un le6n. 


9h 






del hombre. 




i 

23h 

t 


Me gusta la lechuga. 


53 




2h9 


Es el sol. 


3h 
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250 


La llama vive en 


85 




266 


Es un toro. 


81 




la America del Sur. 




















267 


Es un sofd. 


87 


251 


El le6n tiene 


U8 












una cola. 






268 


Tiene una trompa. 


21 


252 


Es un camello. 


58 




269 


Lleva una falda. 


k2 


253 


Es una oveja. 


33 




270 


Son unas 


38 












servilletas . 




25U 


Es un granero. 


29 


















271 


Es un pato. 


35 


255 


Es una taza. 


36 


















272 


Lleva un abrigo. 


3U 


256 


Hace frlo. 


5 


















273 


Hace calor. 


58 


257 


Es una vaca. 


62 


















27U 


Es el pan. 


33 


258 


Es una cebra. 


65 


















275 


Es una camisa. 


55 


259 


Es la leche. 


61 


















276 


Toma leche. 


55 


260 


Es un cerdo. 


30 


















277 


Es una jirafa. 


75 


261 


El padre tiene 


65 












una pipa. 






278 


Es una cuchara. 


U6 


262 


Son pantalones. 


81 




279 


Son zapatos. 


60 


263 


Aqui tenemos un 


83 




280 


Es un cochino. 


33 




refrigerador. 




















281 


Es una alfombra. 


67 


26k 


La sandla es 


U2 












dulce . 






282 


EstA lloviendo. 


32 


265 


La madre lava los 


52 




283 


Me gusta el mel6n. 


59 




platos . 




1 
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28U 


Son guantes. 


50 




300 


Me gustan las 
zanahorias . 


25 


285 

286 


£s un tenedor. 


50 




301 


Es un ganso. 


6k 


Va a lavar la 
ropa. 


51 




302 


Es una coliflor. 


80 




287 


La gallina vive 
en la granja. 


57 




303 


Es el oso mediano. 


6k 










30U 


El tocador es un 


77 


288 


Es el invierno. 


20 






mueble. 




289 


Me gustan los 


75 




305 


Es un cuadro. 


32 


plAtanos. 






306 


Me gustan las 


*♦7 




290 


Hay un mantel. 


30 






cebollas . 




291 


Bebo leche. 


33 




307 


Toma sopa. 


56 


292 


El pollito vive 


72 




308 


EstA nevando. 


12 




en la granja. 






309 


Son cortinas. 


53 


293 


Es un sillSn. 


12 




310 


Es un caballo. 


38 


29*+ 


Los camotes son 
legumbres . 


11 




311 


Asi se toca el 


63 












piano. 




295 


Es came. 


9 




312 


Lleva calcetines. 


*+7 


2^ 


Es un vaso. 


UO 




313 


Es un mono. 


U3 


297 


Me gusta la piba. 


72 
















3lU 


La madre seca los 


31" 


298 


Son platos . 


58 






platos. 




299 


Es un mueble. 


2k 




315 


Es el jardin 
zool6gico. 


k3 
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3l6 


Es el otofio. 


U7 




330 


Voy a doblar 


k2 












la ropa. 




317 


Maria lleva una 


26 












gorra. 






331 


Me gustan las 


60 


318 


Miren mi canasta. 


Ul 






papas . 












332 


Es mi animal 


71 


319 


La colgadura es 


2k 






favorito. 






para la ventana. 




















333 


Enero trae el 


50 


320 


La bicicleta estd 


58 






frio. 






en el garaje. 




















33U 


Es el ndmero 


82 


321 


Es un pavo. 


k3 






noventa. 




322 


El padre estA en 


6k 




335 


El tigre es fSroz. 


87 




la sala. 




















336 


iQu6 bien! 


66 


323 


Lleva unas botas. 


35 


















337 


Junio trae las 


71 


32U 


Toca la campana. 


35 






vacaciones . 




325 


El muchacho lleva 


62 




338 


Ella come cereal. 


31 




ropa. 




















339 


El le6n tiene una 


57 


326 


Tenemos muchas 


51 






melena hermosa. 






cosas . 




















3U0 


Come pan con 


U7 


327 


Es enero. 


70 






mantequilla. 




328 


El le6n tiene 


50 




3Ul 


La pelota es parda. 


32 




cachorros. 




















3U2 


Noviembre trae las 


32 


329 


6Come pan tostado? 


58 






hojas. 








mmmmm 
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343 


Lleva unas botas 


56 




359 


La madre compra 


42 




elegantes . 








legumbres . 




344 


Es el nfamero 


60 




360 


Es un mes. 


49 




setenta. 




















361 


Me gusta 


37 


345 


Es dulce. 


34 


















362 


La madre le da 


45 


346 


Necesito un mantel. 


44 






comida al perro. 




347 


Sabemos muchas 


32 




363 


Es el cuarto mes. 


68 




canciones. 




















364 


El change come 


52 


348 


Lleva una 


39 






cacahuetes . 


/ 




capa de agua. 




















365 


Julio trae las 


37 


349 


Maria lleva medias. 


30 






noches cortas. 




350 


Vengan a ver mi 


78 




366 


Voy a lavar la 


40 




chacra. 








ropa. 


' 


351 


Diciembre trae los 


45 




367 


El verano trae el 


51 




dias de la Navidad. 








sol brillante. 




352 


La muchacha come 


52 




368 


Es la primavera. 


48 




huevos . 




















369 


Vamos a hablar. 


33 


353 


Es el tercer mes. 


19 


















370 


Es el primer mes. 


31 


354 


Es el nfamero cien. 


53 


















371 


El tiene un 


48 


355 


Necesito un vaso 


6l 






par de pantalones. 






para el agua. 




















372 


Es una canci6n. 


40 


356 


No es dificil. 


38 


















373 


La muchacha come 


45 


357 


Es mi amigo. 


74 






huevos fritos. 




358 


Come galletas. 


38 




374 


Es el segundo mes. 


48 
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^ The parentheses vithin an utterance indicate that the element for that slot is optional. However » if the slot 
is filled, it must be with the element indicated in the peurentheses to be scored correct. A detailed description of 
the procedures used in scoring is presented in Chapter U of this report. 
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f The parentheses within an utterance indicate that the element for that slot is optional. However, if the slot 
is filled, it must be with the element indicated in the parentheses to be scored correct. A detailed description of 
the procedures used in scoring is presented in Chapter U of this report. 
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/ The number designates the test sentence in which the feature being ewaluated appeared. The letter designates 
the feature itself, thus shoving when more than one feature in a test sentence w€is evaluated. 
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COPIES OF INSTRUMENTS USED IN 
COLLECTING DATA ON INDEPENDENT VARIABLES 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
STUDENT INFORMATION 

(To be filled out by the teacher) 



Name 


Teacher 


School 


District 


Date 


Method of Instruction 



1. The student's IQ as reported in the cumulative folder is 

2. The average of the subject letter grades received by the student in the 
fifth grade, in terms of the numerical scale given below i s 

A equals 1 B equals U C equals 7 

A- equals 2 B- equals ^ C- equGds 8 

B+ equals 3 C+ equals 6 D+ or less equals 9 

3. The student's grade placement score in reading achievement is 

U. The age of the student in months is 

5* The sex of the s-uudent is (Please check) Male_ ^(l) Female {2) 

6. The occupation of the student's parents (guardieui or stepparent where ap- 
plicable). In the blanks below please write the number of the occupationcuL 
class (from those listed) which best describes the occupation of each parent. 
Indicate if imemployed or deceased, using category (8) or (9). 

Father 



Mothe r 

(1) Professionals and proprietors of large businesses (businesses esti- 
mated at a value of more than $^,000) 

(2) Semi -professionals and lesser officials of large businesses 

(3) Clerks and kindred workers 
(U) Skilled workers 

{3) Proprietors of small businesses (businesses estimated at a value of 
less than $3,000) 

(6) Semi-skilled workers (including protective workers and service workers) 

(7) Unskilled workers (including laborers and domestic servants) 

(8) Unemployed 

(9) Deceased 

Note to the reader : The names of the intelligience and reading achievement tests 

and the dates of administration were also collected. 
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UOT 

7. Please indicate with a check mark which one of the following categories the 



student falls into: 

Stiidents who have had at least 2 semesters of Spanish ^(l) 

Students who have had some Spanish, hut less than 2 ( 2) 

semesters 

Students who have had some scholastic training in a ^(3) 

language other than English, hut no scholastic train- 
ing in Spanish 

Students who have had no scholastic training in a ( ^) 

language other than English 



8. Please find out from the student whether or not Spanish is spoken fairly regu 
larly in the student’s home. Yes ( l); N o ( 2) 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
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SPANISH RESEARCH PROJECT D-177 



STUDENT QUESTIONNAIRE* 



Name Grade Date 

School School District 



To the student 



Beginning on the next page are a list of sentences. If you agree with the 
sentence, mark an X under true. If you do not agree, mark an X under false . 
These marks should tell us what you think not what someone else thinks. Your 
teacher will not be told of your answers and they will have no effect on your 
grade . 

Two examples are given on this page. In both cases these were marked by a per 
son who likes ice cream. 



Example 

True False 

1. X I like ice cream. 

2. X I do not like ice cream. 



Now turn the page and begin answering the items. 



* Produced by System Development Corporation in performance of California 
State Department of Education Contract No. 2^91. 







September 196U 
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True False 



1 . 

2 . 

3. 

h. 

5. 

6 . 

7 . 

8 . 

9. 

10 . 

11 . 

12 . 

13. 

lU. 

15. 



Even if I work very hard, I don't think I'll do well in 
Spanish. 

I think anyone who makes good grades in English can learn 
Spanish. 

Since they are giving us new things to study, I am glad it 
is Spanish . 

Studying Spanish might help to improve your English. 

Spanish would be my first choice if I could choose all 
my subjects. 

I think Spanish will be harder to learn than my other 
subjects. 

I would like to have Spanish every day rather than Just 
two or three days a week. 

If you could not speak Spanish, it would not be fun to 
spend a summer in a Speuiish speaking country. 

I think Spanish will be an easy language to learn. 

I would like to make friends with some Spanish people. 

I am a little worried that I will not do as well in 
Spanish as in m^ other subjects. 

Knowing Spanish helps you with most things you do. 

I would like to learn Spanish even if it meant less time 
for some other subject. 

Spanish would be my last choice if I could choose all 
my subjects. 

If I do well in Spanish, I'll be surprised. 



o 



SCORING KEY 



STUDENT QUESTIONNAIRE 



PRE- AND POSTTRAINING 



Interest Items 



Item Number Positive Response 

3 T 



5 

7 

13 

lit 



T 

T 

T 

F 



Confidence Items 



Item Number 



1 

6 

9 

11 

15 



Positive Response 
F 



F 

T 

F 

F 



No^: Items 2, U, 8, 10, 12 did not count in either the interest or confi* 

dence scores. 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
TEACHER BACKGROUND QUESTIONNAIRE 



Teacher *s Name 

School District 

Date Method of Instruction 



1. Do you have an academic degree beyond the bachelor's degree? (Please check) 

YES {1)\ NO ^(2) 

2. Please indicate with a check mark which one of the following categories des- 
cribes you: 

Teachers whose native language Is Spanish (l) 

Teachers who have studied Spanish in a coimtry where ( 2) 

the language is spoken natively, but who are not native 

speakers 

Teachers who have had at least 2 semesters (or the ( 3 ) 

equivalent in quarter hours) of college training in 
Spanish, but have not studied Spanish in a country where 
It Is natively spoken and are not native speakers 

Teachers who have had some college training in Spanish, but ^t^) 

less than 2 semesters, and/or some high school training in 
the language, but have not studied Spanish in a country 
where It is spoken natively and are not native speakers 

Teachers who have had some academic training in a foreign ( 5 ) 

language other than Spanish, but none in Spanish, Euid are 
not native speakers of Spanish 

Teachers who have had no academic training in a foreign ( 6 ) 

language 

3. If you are not a native speaker of Spanish and you have not studied Spanish 
in a country where it is spoken natively, please indicate which of the fol- 
lowing categories describes you: 

Teachers who have traveled in a country where Spanish ( l) 

is a native language 



Note to the reader : Items 1, 3, and 6 were not Included in the analysis. 



o 
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Teachers who have traveled in a country where a foreign {2) 

language other than Spanish is spoken, but have not 
traveled in a country where Spanish is spoken 

Teachers who have not traveled in a country where a ^(3) 

foreign language is spoken 

U. Please indicate with a check mark which one of the following categories 
describes you: 

Teachers who have had at least five years* experience as (l) 

instructors in the speaking of Spanish 

Teachers who have had some experience, but less than five {2) 

years as instructors in the sneaking of Spanish 

Teachers who have had some experience as instructors in the ^(3) 

speaking of some foreign language other than Spanish, but 
who have had no experience as instructors in the speaking 
of Spanish 

Teachers who have had no experience as instructors in the ^(U) 

speaking of a foreign language 

3* How would you describe your present fluency in Spanish? (Please check one 
of the following) 



Little or no fluency at adl 


(1) 


Some fluency 


(2) 


Native or near-native fluency 


(3) 



6. Please list other foreign languages in which you have some fluency 



7* Please list your age in terms of the following general categories: 





20s 


(1) 


UOs 


(3) 








30s 


(2) 


50s 


W 


60 or more 


(5) 


8. Sex: 


Male 


(1); 


Female 


(2) 







THANK YOU VERY MUCH FOR YOUR COOPERATION. 




CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
TEACHER QUESTIONNAIRE 
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Your answers to these questions are to he used only in statistical aneJ-ysis 
and will not be connected with your name beyond the initial stage of data 
processing* 



Name 

School D istrict 

Date 



1. What degree of difficulty do you feel is involved in learning Spanish as 
compared to learning other foreign languages? (Please check one) 

More difficult than most other languages (l) 

About as difficult as most other languages (2) 

Less 'Ifficult than most other languages (3) 

2. Which of the following statements is closest to your feeling about sixth 
graders being taught Spanish? (Please check one) 



It is extremely worthwhile (l) 
It is fairly worthwhile (2) 
It can't do any harm (3) 
It should not be undertaken W 



3. To what extent do you feel you will enjoy teaching Spanish to sixth 
graders in this project? (Please check one) 



Very much 


(1) 


Not very much 


(U) 


Pretty much 


(2) 


Not at all 


(5) 


Somewhat 


(3) 







U. How much emphasis do you feel should be placed on the learning of a 

foreign language in comparison to other subjects normally taught at this 
level? (Please check one) 

More emphasis than for the average subject (l) 

About as much emphasis as for the average subject (2) 

Less emphasis than for the average subject (3) 



Note to the reader: Item 2 was used to measure the teacher's attitude toward 

teaching Spanish to sixth graders. Item 3 vas used to measure the teacher's 
enjoyment in teaching a project class. The other two items were not analyzed. 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
FINAL CLASS VISIT REPORT MLA 



Name of teacher^ 
District 



School 



^Period begins^ 
'Period ends 



A. USE OF SUPPLEMENTARY MATERIALS 
1. Visuals: 



Suggested in coxirse (circle one) 

Other 



If other, specify^ 



YES 

YES 



If yes, describe the test_ 



7 , Any other type of material: (specify)^ 



NO 

NO 



2 . 


Records or tapes: 


Suggested in course 
Other 


YES 

YES 


NO 

NO 


3. 


±T Oulier f aucuAxjr 

Songs and/or games: 
T<p S'neclfv 


Suggested in course 
Other 


YES 

YES 


NO 

NO 




Films or film strips: 




YES 


NO 


U. 






ir yes 5 aucuxxjf 

Other text materials: 




YES 


NO 


5. 




6 . 


xr yes f bucuxaj 
Tests : 


Short (less than half the period) 
Long (full period) 


YES 

YES 


NO 

NO 



*B. TEACHER PREPAREDNESS 

1 . Was the teacher usually familiar with the lesson prior to YES HO 
class? 

2 . Had she usually arranged and ordered her material prior to YES HO 
class? 

t.o the reader : Those items marked with an asterisk were not included in the 

analysis of data. 
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3. Did she generally use all the essential parts of the lesson? YES NO 

*C. STUDENT PARTICIPATION 

1. How many times on the average were choral responses called for? (Check one) 

a. Not at all c. 20 to 39 e. 60 or more 

b. Up to 19 d. Uo to 59 



2. Usually what proportion of the class was called upon to respond individu- 
ally at least once? (Check one) 

a. Most of the class ____ c. Only a few students 

b. About half the class d. None 



3. Where individual responses were called for, the teacher generally tended 
to call upon the same few students over and over. (Circle one) YES NO 



»D. CORRECTION OP STUDENT ERRORS 

The teacher corrected mistakes (Check one) a. Frequently 

b. Rarely ___ 

E. AMOUNT OF ENGLISH SPOKEN IN THE CLASS 

1. How often did the teacher speak English in the Spanish class? (Check one) 

a. Rarely c. Frequently 

b. Now and then d. Almost always 

2. How often did the students speak English in the Spanish class? (Check one) 

a. Rarely c. Frequently 

b» Now and the n d. Almost always 

*F. VARIETY OF ACTIVITY IN THE CLASSROOM 

1. In comparison with other classes using MLA materials, how frequently did 
this class have a change of activity during a typical session? 

a. More often than average 

b. About as often as the average 

c. Less often than average — — — 

2. Were there periods when there was noticeable silence in the classroom? 
(Check) 

a. Frequently c. Rarely 

b. Now and then 



* Not included in the analysis of data. 
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*G, RATE OF INTRODUCTION OF COURSE MATERIAL 

The dess has met« for a tfOt^al of hours during the year* 



•H. CLASSROOM ENVIRONMENT 

1. Could the teacher be heard clearly all around the room? (Circle one) 

YES NO 

2. Could student responses generally be heard clearly around the room? 

YES NO 



I. MODELING 



How often did the teacher model? (Check one) 

a. Almost always d* Rarely 

b. Frequently e. Never ' 

c. Now and then 



CHECK LIST FOR DESCRIPTIVE AND ANECDOTAL COMMENTS 

1. Timing , pacing. The timing or pacing of instruction tended to be (a)faster 

than average; (b) average; or (c) slower than average. Please explain the 
basis for your Judgment. 



2. Discipline. Was class discipline maintained? If no, explain. We are in 
terested only in the extent to which discipline affects the instruction. 



3. 



R apport . Rapport between the teacher and students was (a) above average 
(b) average; or (c) below average. Elaborate. * 



k. Regular or s ubstitute teacher . Was this class taught by the regular teacher 
or by a substitute teacher? T*eacaer 



Note to tly reader ; Descriptive and anecdotal comments were read for background 
but were not subjected to formal analysis. acagrouna. 
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3. Physical arrangement . Was the physical arrangement of the class, e.g. , 
seating, conducive to maintaining the attention of all the students? 
Explain. 



6. Circulation of teacher . Did the teacher move freely among the pupils or 
did he genercdly sit at his desk or tend to stand in one spot? 



7* Nonverbal aspects . Did the teacher provide a good model of the nonverbal 
aspects of the Spanish language, e.g., gestures, voice level? If not, 
please explain. 



8. Supplementary materials . Comment on the manner of using whatever supple- 
mentary materials were Introduced. 



9. Use of English . For what purposes was English used in the Spanish class 
by the teacher? 



By the students? 



10. Student attitude . Mark an X in the box below that best indicates the 

attitude that was reflected generally in the students' behavior in class. 

Very negative: : : : : : : :Very positive 



1 2 3 



5 6 7 
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SPANISH RESEARCH PROJECT D-177 
FINAL CLASS VISIT REPORT SPA 
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Name of teacher School 

District Period begins 

Period ends 

A. USE OF SUPPLEMENTARY MATERIAL 



1. visuals 

If other, specify 


Suggested in course (Circle one) 
Other 


YES 

YES 


NO 

NO 


2. Songs and/or games: 


Suggested in course 


YES 


NO 




Other 


YES 


NO 


If other, specify 


3. Films or film strips 


: Suggested in course 


YES 


NO 




Other 


YES 


NO 


If other, specify 


Other text materials 


• 

• 


YES 


NO 


If yes, specify 


*5. Tests: 


Short (less than half the period) 


YES 


NO 


If yes, describe the 


Long (full period) 
test 


YES 


NO 



6. Any other type of material (specify) 



B. CLASSROOM ENVIRONMENT 



1 . 



Is there generally activity going on in the room at the time students are 
using the program? yes Nn 



2, Are students using the program usually under supervision? YES 

3. Do students have access to machines other thaui during regu* YES 
larly scheduled sessions? 

If so, when and for how long? 



»Note to the reader ; Those items marked with an asterisk were not included in 
the analysis of data. 



DISPLAY SESSIONS 



Ul9 



C. 

1. How often are display sessions held? 

How long is the display session? 

*3. Is the display session guide provided by the program usually followed? 
YES NO 

*4. How often does the classroom teacher speak English in display sessions? 
(Check one) 

a. Rarely c. Frequently 

b. Now and then d. Almost always 

*D. RECORDING WRITTEN RESPONSES TO PROGRAM 

Students write their responses to the programmed stimuli in (Check one) 

a. The program books 

b. Separate answer sheets 

/check list for DESCRIPTIVE AND ANECDOTAL COMMENTS 

!• Discipline . Was class discipline maintained? If no, explain. We are inter- 
ested here only in the extent to which discipline affects the instruction. 

2. Supplement ary materials . Conment on the manner of using whatever supple- 
mentary materials were Introduced. 



3. Use of English . For what purposes was English spoken in the display sessions? 
By the teacher? 



! 

By the students? 



* Not. Included in the analysis of data. 

/ Descriptive and anecdotal comments were read for background, but were not sub- 
jected to formal analysis. 
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h . Teacher use of program . Did the teacher go through the program himself? 



5 . Physical arrangement . How many stations are set up? In what manner is the 
use of the stations scheduled? What is the ratio of machines to students in 
the class? 

6. Distracting noise in classroom . Was there other activity going on in the 
class while students were using the machines? If so, was this other acti- 
vity distracting to the students on the machines? Was the noise made by 
students using the machines distracting to the rest of the class? Describe 
fully. 



7 . Interaction among pupils . Were pupils aware of what others were doing 

around them? Was there any interaction among pupils while they were using 
the program? Describe. 



response to program . Did pupils speak up in working with the program? 
Were they reminded by the teacher to do so? 



9. Operational problems . What problems did the students encounter in operating 
the tape recorder and the text? Did the teacher help them? Did the pupils 
ask for such help? Was the teacher able to spot pupils who had difficulty in 
using the materials? Elaborate. 



10. Student attitude . Mark an X in the box below that best describes the atti- 
tude that was reflected generally in the students' behavior in class. 

Very negative: : : : : :Very positive 



1 2 3 U 5 6 7 



o 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-17T 
FINAL CLASS VISIT REPORT UAE (TV DAY) 



f . < . ■» V ; /li . '-pp *■ 'i ■ ^ Si ^ 



Name of teacher_ 
District 



School 



_Period begins_ 
Period ends 



A. WARM-UP AND FOLLOW-UP SESSIONS 

1. Is there generally a warm-up session? (Circle one) YES 

If yes, how long usually_ 

*2, What model is generally used during the warm-up session? 



3. Is there generally a follow-up session? 

If yes, how long usually. 

*U, What model is generally used during the follow-up session: 



NO 



a. 


Classroom teacher? 


YES 


NO 


b. 


Recording? 


YES 


NO 


c. 


Native-speaking student? 


YES 


NO 



a. 


Classroom teacher? 


YES 


NO 


b. 


Recording? 


YES 


NO 


c. 


Native-speaking student? 


YES 


NO 



♦B. TV RECEPTION 

1. The picture is usually (check one) good . 2. The sound is usualxy 

poo r » goo d » 

poor . 

3. How many TV sets are used for the Spanish class in this room?. 

4. The picture can he seen clearly in the room (Check one) 

a. by all the students . d. by only a few students 

b. by most students • ©• Dy none of the students 

c* by some students * 

5. What is the number of students in the viewing group? 



» Note to the reader : Those items marked with an asterisk were not included in 

the analysis of data. 
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STUDENT PARTICIPATION 

1. What proportion of the class usually participated in the responses called 
for? (Check one) 

a. Most of the class c. Only a few students 

b. About half of the class c. None 



2. Does the classroom teacher generally respond to the TV teacher along with 
the students? (Circle one) YES NO 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
FINAL CLASS VISIT REPORT UAE (NON-TV DAY) 



Name of teacher School 

District Period begins 

Period ends 

*A. USE OF SUPPLEMENTARY MATERIALS 



1. Visuals: 

If other, specify 


Suggested in course (Circle one) 

Other 


YES 

YES 


NO 

NO 


2. Records or tapes: 


Suggested in course 


YES 


NO 


Other 


YES 


NO 


If other, specify 


3. Songs and/or games: 


Suggested in course 


YES 


NO 




Other 


YES 


NO 


If other, specify 


Films or film strips: 




YES 


NO 


If ves. specify: 


5. Other text materials: 




YES 


NO 


If yes. specify: 


6. Tests: 


Short (less than half the period) 


YES 


NO 


Long (full period) 

7. Any other type of material: (specify) 


YES 


NO 



*B. TEACHER PREPAREDNESS 



1. 


Was the teacher usually familiar with the lesson prior to 
class? 


YES 


NO 


2. 


Had she usuEdly arranged and ordered her material prior 
to class? 


YES 


NO 


3. 


Did she genercdly use all the essential parts of the 
lesson? 


YES 


NO 


*Note to 


the reader: Tliose items marked with an asterisk were not 


included 


in 



the analysis of data. 




STUDENT PARTICIPATION 
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1. How many times, on the average, were choral responses called for? 
(Check one) 

a. Not at all c. 20 to 39 «• 6o or more 

b. Up to 19 d. UO to 59 

2. Usually what proportion of the class was called upon to respond indi- 
vidually at least once? (Check one) 

a. Most of the class c. Only a few students 

b. About half the class d. None 

3. Where individual responses were called for, the teacher generally 
tended to call upon the same few students over and over* (Circle one) 
YES NO 



*D. CORRECTION OF STUDENT ERRORS 

The teacher corrected mistakes (Check one) a. Frequently 

b . Rarely 

E. AMOUNT OF ENGLISH SPOKEN IN THE CLASS 

1. How often did the teacher speak English in the Spanish class? (Check 
one) 

a. Rarely c. Frequently 

b. Now and then d. Almost always 

2* How often did the students speak English In the Spanish class? (Check 
one) 

a. Rarely c. Frequently 

b. Now and then d. Almost always 



*F. VARIETY OF ACTIVITY IN THE CLASSROOM 

1. In comparison with other classes using the TV program, how frequently 
did this class have a change of activity during a typical non-TV ses- 
sion? 

a. More often than average 

b. About as often as the average 

c. Less often than average 



o 



*Not Included in the analysis of data 
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2 . 



Were there periods when there was 
(Check) 



a noticeable silence in the classroom? 



a. Frequently 

b. Now and then 

c . Rarely 



^ 0 , CLASSROOM ENVIRONMENT 

1. Could the teacher usually be heard clearly all around the room? 

(Circle one) YES NO 

2. Could student responses generally be heard clearly around the room? 

YES NO 

3. What is the number of students in the class? 

H. MODELING 



•1. 


Is a native— speaking student used for modeling? 


YES 


NO 


*2. 


Is a tape or record used for modeling? 


YES 


NO 


3. 


Did the classroom teacher model? 


YES 


NO 


>‘CHECK 


LIST FOR DESCRIPTIVE AND ANECDOTAL COMMENTS— 







1. T jjning , Pacing. The timing or pacing of instruction tended to be (a) faster 
than average; (b) average; or (c) slower than average. Please explain the 
basis for your Judgment. 



2. Discipline. Was class discipline maintained? If no, explain. We are inter- 
ested only in the extent to which discipline affects the instruction. 



3. Rapport. Rapport between the teacher and students was (a) above average; 
(b) average; or (c) below average. Elaborate. 



*Not included in the analysis of data. 

^Descriptive and anecdotal comments were read for background, but were not sub- 
jected to formal analysis. 
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nentaty matCTi^s'were^intro^ed. °" *"’* ““"«r of using i*atever supple- 



8 . 



Use of English , 
by the teacher? 



For what purposes was English used in 
By the students? 



the Spcmish class 



s.i;xvs.isir "«■ 



Very negative: 



,:Very positive 



12 3k 



5 6 j 



10 , 



SHd^Ka^ t“^°p;rio^ 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 
SPANISH RESEARCH PROJECT D-177 
IMPLEMENTATION QUESTIONNAIRE 



Name of District 



County 






1. Number of classes in the district taking part in the research project at the 
time classroom instruction began, by method of instruction: 

Una aventura espaflola » Spanish A . .. — 



COST FACTORS 

2. Total cost of equipment ,^ including installation, for project classes in 

this district, broken down (or prorated) by method of instruction (including 
A.11 sources, such as NDEA, etc.): 

$ MLA; $ Una aventura espafiola; $ Spanish A. 

What items are included in this total cost figure in addition to those 
acquired through an NDEA grant? (specify method of instruction) 



3. Total cost of materials^ for project classes in this district, broken down 
(or prorated) by method of instruction (including all sources, such as 
NDEA, etc.): 

$ MLA; $ Una aventura espafiola; $ Spanish A. 

What items are included in this total cost figure in addition to those 
acquired through an NDEA grant? (specify method of instruction) 



1 equipment includes tape recorders, projectors, screens, TV sets, TV an- 
tennae, TV cables, record players, etc. 

2 materials includes booklets and other text materials, films, film strips, 
records, tapes, etc. — anything that contains subject matter content. 



1 o 
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°f in-service training for project teachers in this district, 

prorated) by method of instruction (including all sources. 

°r additional personnel paid out of district funds; 

“ ® paid \mder NDEA, estimated at $100 per day; travel expenses 

of P®f*^®^Pate in in-service meetings; or the cost-accounting 

or regular district personnel. ) : ® 



_MLA; $ 



JJna aventura espahola; $ 



_Spanish A. 



^ classes in this district broken down (or 

^o™«^ L"!? + ^°5 (including all sources, such as the cost 

accounting of district personnel or payments made to an outside agent): 



$_ 



_MLA; $ 



JUna aventura espafiola; $ 



_Spanish A. 



List the kinds of maintenance jobs involved in this total cost figure as bro- 
ken down (or prorated) by method of instruction: 



PERSONNEL 



6. How were teachers recruited for the project (please check appropriate blanks): 



a. 


Accepted all volunteers. 




MLA 


: Una aventura aapnftrtlo 


Spanish A 


b. 


Selected from among volunteers. 


MLA 


; Una aventura espafiola : 


Snanish A 


c. 


Selected from among all teachers available. 




MLA 


; Una aventura espafiola ; 


Spanish A 



If iStructi^r® selection (specify method 



7 . 




Where were the teachers for the project found? 
teachers in the appropriate blanks) 



(Please list the number of 



a. Among district teachers. 



MLA 



b. 



MLA 



; Una aventura espafiola 

Outside the district. 

; Una aventura espafiola 



Spanish A 



Spanish A 
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TIME FACTORS 

8. Please estimate the number of hours spent by each type of office or per- 
son listed below in connection with the research project. 

a. Superintendent's office: prior to the beginning of instruction 

during the school year 

Please list the activities that are included in this time estimate: 



b. Business office: prior to the beginning of instruction 

during the school year 

Please list the activities that are included in this time estimate: 



c. Maintenance technician: prior to the beginning of instruction 

during the school year 

Please list the activities that are included in this time estimate: 



d. Supervisors: prior to the beginning of instruction 

during the school year 

Please list the activities that are included in this time estimate: 



e. Principals: prior to the beginning of instruction 

during the school year 



Please list the activities that are included in this time estimate: 
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f. Teachers: prior to the beginning of instruction 

during the school year 

Please list the activities that are included in this time estimate: 



9* If instruction was given in a room other than an ordinary classroom* where 
was it given? 



If there are any other comments which you might have regarding the implementation 
of any of these Spanish programs, please use this space: 



Thank you very much for your help. 



APPENDIX E 
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PERT ANALYSIS OF THE PROJECT 



In conducting a large scale research project— particularly one involving 
classrooms located across the width and breadth of the entire state of 
California and hundreds of studencs— —administration is a crucial and time-con- 
suming function* This project involved a fulltime staff of six professional 
people and a secretary, several special consultants, each of whom devoted a num- 
ber of days to the project, part-time clerical help and several professional 
people in a co-contracting organization* The coordination of the efforts of all 
these people was a problem of major concern* An extremely useful tool^which can 
be brought to bear on such a problem is the Program Evaluation and Review Tech- 
nique (pert)* 

The introduction of PERT into educational research and development projects 
is a relatively new thing* The technique originated in connection with a pro- 
ject begun in 1958 by the Navy Special Projects Office to study the application 
of statistical and mathematical methods in the management and coordination of a 
major research and development program— the Fleet Ballistic Missile Program, 
better known as the Polaris submarine* 

The PERT technique is novel in eliminating the traditional bar charts for 
showing schediaes and substituting a network showing graphically the inter-rela- 
tionships among activities and the systems of contingencies that lead to the 
ultimate completion of the project* 

About halfway through the current project, it was decided to develop a 
PERT network for it in order to gain a clearer perspective of the overall pat- 
tern of activities and to determine the feasibility of the PERT technique in 
the conduct of a statewide field test of instructional programs. It was thought 
that starting a PERT analysis even halfway through the project might provide 
some insight into possible difficulties in completing the project* 

Description of Central Concepts in PERT 

It has been said that PERT will not save your life, but it will tell you 
what is killing you* There is nothing magical about the technique. It is simply 
a tool of administration that if properly applied, will result in a more thorough, 
more detailed, and more precise analysis of the job to be done than would probably 
be made otherwise* It must be continually revised to be maximally useful* 

The PERT network is like a map showing the administrator how to get from one 
point to another— from the beginning of his project to its completion* The net- 
work will very likely involve several paths to the goal, some shorter than others# 
The longest of such paths is called the critical path because the project cannot 
possibly be completed in less time than it takes to complete the longest sequence 
of activities* 

The network is constructed of lines and circles* Each circle, called an 
event, represents the completion of one activity and the subsequent beginning 
of the next activity in the chain* Each line, between two events represents an 
ongoing activity* Each activity acts as a constraint on the activity immediately 
following* That is, an activity cannot commence until all those which lead Into 

it are completed* 




\ 
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There is an expected elapsed time for each ongoing activity. This parameter 
may be a single estimate of the time it will take to complete an activity, or it 
may be a statistically weighted average of the most optimistic estimate, the most 
pessimistic estimate and an estimate of the most likely time. 

The most optimistic estimate of the expected elapsed time is that length of 
time one would expect the activity in question to take if performed under absolutely 
ideal conditions, generally considered to occur only about once in a hundred times, 
if one were to perform the identical activity one hundred times. 

The most pessimistic time estimate is that time one would expect the activity 
to take if everything imaginable went wrong, if every conceivable problem in the 
completion of the activity arose. This is predicted to occur about once in a hund- 
red times. 

The most likely time is the most realistic estimate of the time an activity 
might consume. If a job were repeated many times under similar circumstances, say 
100 times, enabling one to construct a distribution of the length of time the job 
took in each repetition, the modal value of that distribution would be the most 
lik,ely time estimate for that job. 

\7hen the expected elapsed time for each activity has been computed, it is then 
possible to determine the critical path along the network from the beginning of the 
project to the completion of the final activity. The expected elapsed times for 
all activities along a given path through the network are added together, and the 
longest time to traverse a path from beginning to end indicates the critical path. 

The expected elapsed time is also used to compute the earliest expected date 
and the latest allowable date for the completion of a given activity. The earliest 
expected date is computed by adding together the expected elapsed times along the 
longest path to any given event. It may be converted to a calendar date. The 
latest allowable date for the completion of a given activity is computed by subWact- 
ing the sum of the expected elapsed times for activities from the terminal point in 
the project along the longest path back to the event in question. The latest allow- 
able date is the latest calendar date on which a given event can occur without slow- 
ing down the progress of the project. The latest allowable date for the last event, 
the end of the project, may be a directed date specified in a project contract. In 
the absence of a directed date, the latest allowable date will coincide with the 
earliest expected date for the end of the project. 

Every event, i.e., the completion of every activity in the project, has a latest 
allowable and an earliest expected date. The difference between these two figures is 
called slstck , which may be either positive, negative, or zero. If the earliest expect- 
ed date is earlier than the latest allowable date, slack is positive and no difficulty 
in the scheduling of activities is anticipated. However, if the earliest expected 
date for the completion of an activity is later than the latest allowable date, a 
trouble spot is indicated. Negative slack indicates that a reallocation of resources 
is necessary in order to avoid a delay. Low positive slack indicates that if any time 
estimate involves a relatively high degree of error, a problem could easily arise. 

Application of PERT to the Project 

The PERT network for the project can be seen in the figure^- No time estimates are 
given for activities in the network because it was felt that the expected elapsed times 
used in this study would be inappropriate in any other setting. Time estimates must be 



^ A PERT network of the project follows page U39. 
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location°to^ftnn+h^°'^°^ available, and these will vary considerably from one 

of ^WvlUer^a thM ? r ^wstlve as to the kinds 

in*s+>.ii«+4 1 inter-relationships in a large-scale field test of 

th^erlti!a?^o^th®’'““;^ However, some time estimates, particularly those along 
tne critical path are discussed in the text. ^ 

+><0 length of an activity line is unrelated to the expected elapsed time for 

III ”5: "■’f constraint voGirh^ver^de 

^ef^es™ me nLbers”- T “ commensurate increase in 

cation oe on . circles have no significance other than identifi- 

even? botrofvir^^^’ »as a predecessor event and a successor 

br?bl== “™>’>ered. and the activity is identified in the network 

01-02 Thlft!” ’ *‘*® Hiring of field consultants is represented by 

01-02. The heavy black line through the network represents the critical path! 

puted^n te^^rf°Lf ?^"® J^® activity is generally com- 

activitv would man-weeks, meaning that one man working full time on this 

iiniini ae +-I j o^mcny weeks or a fraction of a week to complete it. The 
b^ avalllS whL"^^ “ usi^ PERT is that "the manpower or otlTr resourcerwlll 
day)." (CoL ^106^ r,“int®2 "®^”? average work schedules (i.e.. 8 hour 

Poetical oSri?.!’ '’® pointed out that in the actual 

ful time estimate in ev^ ca«! ’ "“-***^8 was not the most use- 

for a^lven^^i^ !f *’’* *Hat frequently the allocation of resources 

for a given activity was completely out of the hands of the orolect staff 

S l;in«nro?«”® °^^®®l*’r’'^®*® *‘'® P“'°'>®®* the cliifomia 

tate Printing Office. The State Printing Office has its prescribed system of 

completion of jobs. Consequently, it was necessary^to estimate 

the PrintLfoffiL Blloved from the submission of te^master^to 

Jh! U 4^5^^ delivery of the printed booklets back to the prolect 

le t i on of the jo*b ??his ^lid t of six weeks be allowed for the 
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on 'this activitye Four of 'thom were ‘full— * 4- ^ 

act vity, the card punching of the speaking tests could commence. Figuring this 
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'biins in nian—weeks would net have been meaningful in the scheduling of activities* 

As it turned outy the scoring of the speaking tests was spread over a fiveniionth 
period, from August 15, 19^5 to January lJ+, 1966, 22 weeks, nearly four times as 
long as originally anticipated. Needless to say, this length of time resulted in 
rather formidable negative slack. Unfortunately, this error was simply not fore- 
seeable. The activity was without precedent, involving scoring procedures which 
were devised specifically for the tests used in the project. 

The length of the critical path was 92.5 weeks. A sequence of eleven activi- 
ties fell along this path. First was 01-02, the hiring of field consultants. It 
was expected to take 15 weeks to identify the available qualified personnel, con- 
duct negotiations, and consiammate the formalities necessary before they could begin 
to work. Next along the critical path was the recruiting of districts ( 02-08, 11 
weeks). Since the field consultants were key personnel in the recruiting of dis- 
tricts, the consultants should have been hired prior to the recruiting. As was 
pointed out in the chronological account of the project, however, due to the short 
lead time it was impossible to wait until field consultants had been hired to be- 
gin recruiting districts. Consequently, it was necessary to employ several tempo- 
rary consultants to begin this activity. This illustrates the kind of solution 
that must be sought when negative slack is found in the network. 

Since the hiring of the field consultants would not begin until the contract 
had been signed between the USOE, System Development Corporation and the California 
State Department of Education, the hiring could not be completed until well after 
the recruiting of districts had to begin* This meant that the earliest expected 
date for the completion of the hiring of field consultants was later than the latest 
allowable date. The solution to this problem of negative slack was to hire tempo- 
I'ary personnel to begin the recruiting. Since the hiring of temporary personnel 
was only a stopgap and was not a recommended step in the conduct of the project, it 
was not included in the PERT network. 

The hiring of a research consultant is represented by Ol-OU. It can be seen 
that the sampling of classes and the development of several of the data collection 
instruments depended upon the availability of a research consultant. Ideally, this 
person would have been hired early enough to participate in the design phase of 
the project, prior to funding. There is, of course, the problem just mentioned, 
that personnel to be recruited specifically for this project could not be hired 
until the contract with the funding agency had been signed. Consequently, the 
person responsible for most of the research-oriented activities of the project was 
not available to participate in the planning for those activities. 



Following the recruiting of districts, it was necessary to obtain equipment 
and materials for use in the courses to be installed. This again was an activity 
which was essentially outside the control of the project staff. Procuring equip- 
ment and materials is represented by 08-l6, 08-17, 08 -l 8 , one line for each course 
of instruction. It was considered necessary to include a separate line for each 
course of instruction because the estimated time for procuring equipment and mat- 
erials varied from one course to another* It can be seen tha'l the procurement of 

equipment and materials leads into the conduct of the first half of the instruc- 
tioned program. 

The procurement of equipment and materials constitues a constraint on the 
beginning of instruction in Spanish. To simplify the network, the events which 
represent the completion of the equipment and materials procuring stage are joined 
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together in a coamon constraint on the beginning of instruction. The broken line 
Joining these events to the beginning of instruction is a duamy constraint, i.e., 
it does not represent an activity itself, but it does indicate what has to be 
coinpleted before the succeeding activity can begin. Another example of this type 
of network construction can be seen where the development of the final test, 
23-32, leads into several activities, the termination of which constitute a joint 
constraint upon the administration of final tests. 

One external constraint which does not show directly in the network was the 
school year itself. Obviously Spanish classes could not begin until school had 
opened in the fall and could not continue after school had closed in the spring. 
Thus all the instruction and data collection had to be completed during this time. 
Activity 19-2U indicates the conduct of the first half of the instructional pro- 
gram. The expected elapsed time was 15 weeks. In other words, it was estimated 
that it would take approximately 15 weeks to complete the first half of the pro- 
gram. 



It is very likely that this parameter varied somewhat from course to course. 
It would have been meaningful, perhaps, to construct separate paths for each 
course of instruction, but this would have complicated the network unduly. 

In terms of calendar dates, this 15-week period meant that if instruction 
could begin the first week in October it would reach the halfway point during 
the middle of January. Administering the midterm test to any single class 
(21^-27) was expected to take one week. Obviously it did not require a week to 
administer a midterm test. However, the scheduling of testing for a number of 
classes reaching the midway point relatively close together was a prnbT*»Tn, 
Consequently, an average of a week had elapsed between the completion of the 
last unit in the first half of the program and the test administration. Since 
it would have been inadvisable to begin the second half of the program prior to 
the testing for the first half, it was necessary to make testing a cofastraint 
upon the continuation of instruction. 

Activity 2 i *-28 is labeled the administration of the midterm to all UAE-MLA 
classes. It was considered necessary to reflect (in the network) the total 
length of time required for the administration of aJLl midterm tests as well as 
the length of time necessary to test a single class. Activity 2k-29 represents 
the administration of the midterm test to all SPA classes, and this activity was 
given 12 weeks. It was thought useful to represent this sepairately because the 
administration of tests to SPA classes posed special problems due to the self- 
pacing feature of the program. The policy in testing students taking this 
course was to wait xmtil several of them had finished the first half of the 
program and then to administer the test in a group to those students. In a 
number of cases, this meant making more theui one trip to a class to administer 
the midterm. Those students who had taken the midterm continued into the second 
half of the program, regardless of the other students who had not finished the 
first half. 

It was not considered practical to attempt to administer the test individ- 
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ually to students taking SPA. It would have been impossible for the field consul- 
tant to make so many trips to a single class. An alternative might have been to 
allow the teacher to administer the midterm test individually to each student as 
he reached the midpoint in the program. However, in order to maintain test secur- 
ity, it was deemed inadvisable to leave the test materials at the school for any 
length of time. Administering the midterm tests to all classes was not included 
in the same path as the second half of instruction because it was not necessary 
to have tested all classes before continuing instruction in those classes that 

had been tested. 

The second half of the program was estimated to take ih instead of 15 weeks, 
due to the improved efficiency of the teacher. 

Following the conduct of the second half of the program was the administra- 
tion of the final test, represented by activity U1-U2, and Ul-U3. Student and 
teacher postinstruction attitude instruments and the teacher background question- 
naire were also administered at this time. 

Activity U1-U2 represents the administration of the final tests to a single 
class, whereas activity U 1 -U 3 , which is on the critical path, represents the ad- 
ministration of the final tests to all classes. It was considered advisable to 
complete the testing before beginning the processing of data. The processing of 
these data include activities U3-55, ^3-56, and U3-57, representing the process- 
ing of listening comprehension tests, teacher background questionnaire and both 
pre- and post instruct ion teacher attitude questionnaires, and the post in struct ion 
student attitude questionnaire respectively. Processing each of these different 
data instruments was indicated separately in the network because of the differences 
among them in expected elapsed time. The processing of the final listening compre- 
hension tests was expected to take the longest time, four weeks. 

Following the processing of data was the punching of cards. The punching of 
the final listening comprehension tests is represented by 55-58. The last two^ 
activities in the critical path were the analysis of the data and the preparation 
of the final report, each expected to take eight weeks. As it turned out, these 
were under-estimates. 



The most time-consimiing activities in the network, other than the recruiting of 
staff and the conducting of the program of instruction, which have already been dis- 
cussed, were those activities concerned with the development of tests. Activity 
01-07 representing the linguistic analysis of instructional programs was estimated 
to take 12 weeks. The development of the pretest, activity Ol-Oo, nine weeks, was 
carried on concurrently with the linguistic analysis. The pretest was based on 
elements common to all three programs, so these elements had to be identified first. 
The development of the student attitude questionnaire, 01-05, eight weeks, was also 
concurrent with the linguistic analysis. 



Following the linguistic analysis was the development of the midterm tests, 
07-23, taking lU weeks, and then the development of the final tests, 23-32, taking 
26 weeks. Activity 23-2U, feeding from the activities of System Development Corpor- 
ation back into the critical path, was the printing of the midterm test, taking al- 
most six weeks. The printing of course, had to be accomplished before the test 
could be administered. 

The developnent of the final tests leads into several activities which include 
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the printing of the final test booklets, the duplicating of instructions for the 
administration of final tests (including the scripts of the tests), and the de- 
velopment of scoring procedures for the speaking tests. 

As mentioned earlier, all of these activities serve as a Joint constraint 
on the administration of final tests, as indicated by the constraining line that 
feeds back into the critical path at event Ul, the completion of the second half 
of the instruc^tional program. Event Ul, quite naturally, is a kind of focal 
point in the network, as one would expect the termination of instruction to be. 

The other major focal point in the network is event 58 ^ which indicates the 
beginning of data analysis. Nine different activities feed into event 58 . All 
of these nine involve the punching of different data instruments; l) pretest; 

2 ) preinstruction student attitude questionnaire; 3 ) student information sheet; 

4) midterm test; 5 ) final listening comprehension test and reading test for SPA; 

6 ) teacher background questionnaire and teacher attitude questionnaires (pre- and 
postlnstructlon) ; 7) composite class visit reports; 8 ) postlnstructlon student 
attitude questionnaire; and 9 ) speaking tests. 

Two pathways in the network circumvent event 58 and feed into the critical 
path at event 63 , the beginning of the preparation of the final report. Activity 
Ul-UU is the administration of the implementation questionnaire, and UU -63 is the 
analysis of the data from this questionnaire. Activity 59~60 represents the de- 
velopment of the questionnaire on the continued use of Spanish programs during 
the year after the study, followed by the duplication and mailing of the quest- 
ionnaire, the administration of the questionnaire, i.e., the waiting and remind- 
ing necessary to recover a reasonable percentage of a mail questionnaire (in 
this case 100 percent), and the analysis of the data. 3 The analysis of both the 
implementation questionnaire and the continued use questionnaire was conducted by 
hand, rather than fhr punched on cards and machine analyzed. Conse- 

quently, event 58, whicn represents the beginning of the machine analysis of the 
data punched on cards, was bypassed by th^ pathways of activities associated with 
these two questionnaires. 

Activity 1*9-50, represents the hiring of Judges for scoring the speaking tests. 
!Hien came the training of the Judges, the scoring operation itself, and the punch- 
ing of the score sheets into cards. 

Activity Ol-OU represents the hiring of the research consultant, as noted 
previously, and the lines emanating from event lU represent the development of 
Instruments for the collection of data on the Independent variables, including 
the teacher attitude questionnaire, the student information sheet, the preliminary 
class visit report form, the teacher background questionnaire, and the implemen- 
tation questionnaire. These pathways all feed back into the critical path at ap- 
propriate points where a particular instrument had to be administered to students. 

Two other activities which appear to be dangling are 38-1*1 and 39-1*1. 

These represent the duplication of the postinstruction student and teacher atti- 
tude' questionnaires respectively. They appear to be dangling because these post- 
instruction instruments were simply duplicates of the preinstruction instruments, 
with verb tenses changed where appropriate. Therefore, the duplication of these 
forms could take place independent of any other activity, assuming they were 
first used prior to the beginning of instruction. A dummy constraint imposed on 
the duplication of these instruments was the beginning of the second half of in- 
struction. 



3 The data from the questionnaire on the continued use of Spanish programs 
during the year after the study were not included in this report. 
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The PERT network for the project includes 82 different activities. Obviously, 
the identification of activities is a crucial aspect of PERT. 

possible to add still other activities to the network. It might be helpful in some 
cases to combine activities, without doing damage to the process of 
ion, and thereby simplify the network. It might also be help^ to ^reak down some 
of these activities still further. The PERT analyst must decide what breakd^ of 
work activities is the most useful for the particular project in question. These 
82 activities seemed to the project staff to represent a reasonable breakdown of 

tasks to be performed. 



The question naturally arises as to just how useful a PERT network developed 
in one project may be to another similar project. Naturally, the usefulness of the 
network to another project depends upon the similarity of circ^st^ces and operat- 
ing conditions between the two projects. The greater the similarity, the more 
help a network of this type will be. At the very least, it ought to e sugges ye 
of the many different types of functions that must be considered and the complexity 
of the system of constraints running through the network. 



The time estimates are perhaps the least useful part of the PERT design to an- 
other project. Certainly time estimates in the form of man-weeks would be more 
suggestive than estimates in the form presented here. Yet ultimately another pro- 
ject would be forced to translate man-weeks into something more realistic to what- 
ever situation was encountered. Unfortunately, it is virtually impossible to 
reconstruct the actual time spent on each activity in the present project. Since 
PERT was applied to the project after it was half completed, no precise time 
accounting was kept for individual activities. Nevertheless, it is hoped that the 
discussion presented here may prove useful in the conduct of other large scale 
field tests of instructional programs. 
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